Apr 18 16:07:41 user devstack@n-api.service[61293]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 18 16:07:41 user devstack@n-api.service[61293]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Apr 18 16:07:41 2023] *** Apr 18 16:07:41 user devstack@n-api.service[61293]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 18 16:07:41 user devstack@n-api.service[61293]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 18 16:07:41 user devstack@n-api.service[61293]: nodename: user Apr 18 16:07:41 user devstack@n-api.service[61293]: machine: x86_64 Apr 18 16:07:41 user devstack@n-api.service[61293]: clock source: unix Apr 18 16:07:41 user devstack@n-api.service[61293]: pcre jit disabled Apr 18 16:07:41 user devstack@n-api.service[61293]: detected number of CPU cores: 12 Apr 18 16:07:41 user devstack@n-api.service[61293]: current working directory: / Apr 18 16:07:41 user devstack@n-api.service[61293]: detected binary path: /usr/bin/uwsgi-core Apr 18 16:07:41 user devstack@n-api.service[61293]: your processes number limit is 63637 Apr 18 16:07:41 user devstack@n-api.service[61293]: your memory page size is 4096 bytes Apr 18 16:07:41 user devstack@n-api.service[61293]: detected max file descriptor number: 2048 Apr 18 16:07:41 user devstack@n-api.service[61293]: lock engine: pthread robust mutexes Apr 18 16:07:41 user devstack@n-api.service[61293]: thunder lock: enabled Apr 18 16:07:41 user devstack@n-api.service[61293]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 18 16:07:41 user devstack@n-api.service[61293]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 18 16:07:41 user devstack@n-api.service[61293]: Python main interpreter initialized at 0x563452a8e990 Apr 18 16:07:41 user devstack@n-api.service[61293]: python threads support enabled Apr 18 16:07:41 user devstack@n-api.service[61293]: your server socket listen backlog is limited to 100 connections Apr 18 16:07:41 user devstack@n-api.service[61293]: your mercy for graceful operations on workers is 90 seconds Apr 18 16:07:41 user devstack@n-api.service[61293]: mapped 537436 bytes (524 KB) for 3 cores Apr 18 16:07:41 user devstack@n-api.service[61293]: *** Operational MODE: preforking *** Apr 18 16:07:41 user devstack@n-api.service[61293]: *** uWSGI is running in multiple interpreter mode *** Apr 18 16:07:41 user devstack@n-api.service[61293]: spawned uWSGI master process (pid: 61293) Apr 18 16:07:41 user devstack@n-api.service[61293]: spawned uWSGI worker 1 (pid: 61294, cores: 1) Apr 18 16:07:41 user devstack@n-api.service[61293]: spawned uWSGI worker 2 (pid: 61295, cores: 1) Apr 18 16:07:41 user devstack@n-api.service[61293]: spawned uWSGI worker 3 (pid: 61296, cores: 1) Apr 18 16:07:41 user devstack@n-api.service[61293]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 18 16:07:42 user devstack@n-api.service[61294]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 16:07:42 user devstack@n-api.service[61295]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 16:07:42 user devstack@n-api.service[61296]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 16:07:45 user devstack@n-api.service[61295]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 16:07:45 user devstack@n-api.service[61295]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 16:07:45 user devstack@n-api.service[61295]: and ``live_migration_inbound_addr`` respectively. Apr 18 16:07:45 user devstack@n-api.service[61295]: ). Its value may be silently ignored in the future. Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 16:07:45 user devstack@n-api.service[61296]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 16:07:45 user devstack@n-api.service[61296]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 16:07:45 user devstack@n-api.service[61296]: and ``live_migration_inbound_addr`` respectively. Apr 18 16:07:45 user devstack@n-api.service[61296]: ). Its value may be silently ignored in the future. Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 16:07:45 user devstack@n-api.service[61294]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 16:07:45 user devstack@n-api.service[61294]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 16:07:45 user devstack@n-api.service[61294]: and ``live_migration_inbound_addr`` respectively. Apr 18 16:07:45 user devstack@n-api.service[61294]: ). Its value may be silently ignored in the future. Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61295) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61296) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61294) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 16:07:46 user devstack@n-api.service[61295]: INFO dbcounter [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] Registered counter for database nova_api Apr 18 16:07:46 user devstack@n-api.service[61296]: INFO dbcounter [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] Registered counter for database nova_api Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG oslo_db.sqlalchemy.engines [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61295) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG oslo_db.sqlalchemy.engines [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61296) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writer thread running {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writer thread running {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.context [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4(cell1) {{(pid=61295) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG nova.context [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4(cell1) {{(pid=61296) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:07:46 user devstack@n-api.service[61294]: INFO dbcounter [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Registered counter for database nova_api Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:07:46 user devstack@n-api.service[61295]: INFO dbcounter [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] Registered counter for database nova_cell0 Apr 18 16:07:46 user devstack@n-api.service[61296]: INFO dbcounter [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] Registered counter for database nova_cell0 Apr 18 16:07:46 user devstack@n-api.service[61295]: INFO dbcounter [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] Registered counter for database nova_cell1 Apr 18 16:07:46 user devstack@n-api.service[61296]: INFO dbcounter [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] Registered counter for database nova_cell1 Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG oslo_db.sqlalchemy.engines [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61295) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG oslo_db.sqlalchemy.engines [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61295) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writer thread running {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG oslo_db.sqlalchemy.engines [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61296) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG oslo_db.sqlalchemy.engines [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61296) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writer thread running {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writer thread running {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG oslo_db.sqlalchemy.engines [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61294) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writer thread running {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG nova.context [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4(cell1) {{(pid=61294) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:07:46 user devstack@n-api.service[61294]: INFO dbcounter [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Registered counter for database nova_cell0 Apr 18 16:07:46 user devstack@n-api.service[61294]: INFO dbcounter [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Registered counter for database nova_cell1 Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG oslo_db.sqlalchemy.engines [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61294) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writer thread running {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG oslo_db.sqlalchemy.engines [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61294) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writer thread running {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 16:07:46 user devstack@n-api.service[61295]: INFO dbcounter [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] Registered counter for database nova_cell0 Apr 18 16:07:46 user devstack@n-api.service[61296]: INFO dbcounter [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] Registered counter for database nova_cell0 Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG oslo_db.sqlalchemy.engines [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61295) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writer thread running {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG oslo_db.sqlalchemy.engines [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61296) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 16:07:46 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writer thread running {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writer thread running {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 16:07:46 user devstack@n-api.service[61294]: INFO dbcounter [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Registered counter for database nova_cell0 Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG oslo_db.sqlalchemy.engines [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61294) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 16:07:46 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writer thread running {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 16:07:46 user devstack@n-api.service[61296]: WARNING keystonemiddleware.auth_token [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 16:07:46 user devstack@n-api.service[61295]: WARNING keystonemiddleware.auth_token [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 16:07:46 user devstack@n-api.service[61296]: WARNING keystonemiddleware.auth_token [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 16:07:46 user devstack@n-api.service[61295]: WARNING keystonemiddleware.auth_token [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 16:07:46 user devstack@n-api.service[61295]: WARNING keystonemiddleware.auth_token [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 16:07:46 user devstack@n-api.service[61296]: WARNING keystonemiddleware.auth_token [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 16:07:46 user devstack@n-api.service[61295]: WARNING keystonemiddleware.auth_token [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 16:07:46 user devstack@n-api.service[61296]: WARNING keystonemiddleware.auth_token [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 16:07:46 user devstack@n-api.service[61295]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563452a8e990 pid: 61295 (default app) Apr 18 16:07:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:07:46 user devstack@n-api.service[61296]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563452a8e990 pid: 61296 (default app) Apr 18 16:07:46 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-6e2c2795-5eb6-450d-96a1-b6ff0927ba6c None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001678 Apr 18 16:07:46 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Apr 18 16:07:46 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:07:46 user devstack@n-api.service[61294]: WARNING keystonemiddleware.auth_token [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 16:07:46 user devstack@n-api.service[61294]: WARNING keystonemiddleware.auth_token [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 16:07:47 user devstack@n-api.service[61294]: WARNING keystonemiddleware.auth_token [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 16:07:47 user devstack@n-api.service[61294]: WARNING keystonemiddleware.auth_token [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 16:07:47 user devstack@n-api.service[61294]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563452a8e990 pid: 61294 (default app) Apr 18 16:09:54 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:09:54 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-d348cf28-90fe-4d25-ada1-b7eb826d353f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002289 Apr 18 16:09:54 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 1/2] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 16:09:54 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:09:54 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=3 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:09:54 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=3 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:09:54 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=3 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:09:54 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:09:54 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-d06c419e-ddf8-47a2-ba0b-60cac1736bd9 admin admin] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:09:54 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-d06c419e-ddf8-47a2-ba0b-60cac1736bd9 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.451578 Apr 18 16:09:54 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 2/3] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 18 16:09:54 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 16:09:56 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:09:56 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002217 Apr 18 16:09:56 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 16:09:56 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:09:56 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=3 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:09:56 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=3 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:09:56 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=3 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:09:56 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:09:56 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-aeed7703-4812-4792-986e-68f0ee416895 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:09:57 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-aeed7703-4812-4792-986e-68f0ee416895 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.437319 Apr 18 16:09:57 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 2/5] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 16:09:56 2023] POST /compute/v2.1/flavors => generated 405 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 16:09:57 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-77fa7f60-1a23-4e7f-9b3c-46a76c2ebc0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:09:57 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-77fa7f60-1a23-4e7f-9b3c-46a76c2ebc0d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045895 Apr 18 16:09:57 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 3/6] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 16:09:57 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:09:59 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:09:59 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001280 Apr 18 16:09:59 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 16:09:59 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:09:59 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-c7015a69-e830-4ed0-9926-bd0bb265cd45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "name": "ds512M", "rxtx_factor": 1.0, "id": "d1", "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:09:59 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-c7015a69-e830-4ed0-9926-bd0bb265cd45 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076524 Apr 18 16:09:59 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 3/8] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 16:09:59 2023] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 16:09:59 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-a2b5a1be-4881-4ec0-bfe7-4f04c26c93f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:09:59 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-a2b5a1be-4881-4ec0-bfe7-4f04c26c93f9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040003 Apr 18 16:09:59 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 4/9] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 16:09:59 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:10:01 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:10:01 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001300 Apr 18 16:10:01 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 16:10:01 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:10:01 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-a7d568bd-4422-4b14-a3d7-a1309c7e9c96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "ram": 1024, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:10:01 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-a7d568bd-4422-4b14-a3d7-a1309c7e9c96 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.069475 Apr 18 16:10:01 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 4/11] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 16:10:01 2023] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 16:10:01 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-d02f1968-36a3-4109-a8fd-89d8185e57d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:10:01 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-d02f1968-36a3-4109-a8fd-89d8185e57d9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026496 Apr 18 16:10:01 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 5/12] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 16:10:01 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:10:03 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:10:03 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001326 Apr 18 16:10:03 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 16:10:03 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:10:03 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-27eed300-131d-4eb2-991d-ec208424d4c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3"}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:10:03 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-27eed300-131d-4eb2-991d-ec208424d4c6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061518 Apr 18 16:10:03 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 5/14] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 16:10:03 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 16:10:03 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-2a2b7399-023b-4455-aae1-8b98dda9e8f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:10:03 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-2a2b7399-023b-4455-aae1-8b98dda9e8f6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024062 Apr 18 16:10:03 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 6/15] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 16:10:03 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:10:05 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:10:05 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001358 Apr 18 16:10:05 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 16:10:05 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:10:05 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-bfdc793e-3b59-417b-a519-f023023e3ea3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:10:05 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-bfdc793e-3b59-417b-a519-f023023e3ea3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061271 Apr 18 16:10:05 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 6/17] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 16:10:05 2023] POST /compute/v2.1/flavors => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 16:10:05 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-5291c461-8c0e-446c-abda-e3ff7b993080 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:10:05 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-5291c461-8c0e-446c-abda-e3ff7b993080 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024140 Apr 18 16:10:05 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 7/18] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 16:10:05 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:10:07 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:10:07 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-69d6dde9-8bc9-4b67-8406-4a11c5e66436 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001310 Apr 18 16:10:07 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 16:10:07 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:10:07 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-bfcc6674-f8a1-491d-8320-f0269141d4be admin admin] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:10:07 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-bfcc6674-f8a1-491d-8320-f0269141d4be admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.069495 Apr 18 16:10:07 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 7/20] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 18 16:10:07 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:10:09 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-5291c461-8c0e-446c-abda-e3ff7b993080 admin admin] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:10:09 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-5291c461-8c0e-446c-abda-e3ff7b993080 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001467 Apr 18 16:10:09 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 8/21] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 16:10:09 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:10:09 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=3 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:10:09 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=3 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:10:09 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=3 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:10:09 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=3 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:10:09 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-06a9b5c3-dd9d-4cc6-9c4b-0072bf81e27a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "vcpus": 1, "disk": 1, "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:10:09 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-06a9b5c3-dd9d-4cc6-9c4b-0072bf81e27a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.327973 Apr 18 16:10:09 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 16:10:09 2023] POST /compute/v2.1/flavors => generated 400 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 16:10:09 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-84cb4e55-e3eb-4c02-a0ba-0251ff53137e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:10:09 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-84cb4e55-e3eb-4c02-a0ba-0251ff53137e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039368 Apr 18 16:10:09 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 8/23] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 16:10:09 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:10:11 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-5291c461-8c0e-446c-abda-e3ff7b993080 admin admin] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:10:11 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-5291c461-8c0e-446c-abda-e3ff7b993080 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001338 Apr 18 16:10:11 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 9/24] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 16:10:11 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:10:11 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-4a301b5e-2596-4af7-a6b9-26f7cf85e2c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "name": "m1.small", "disk": 20}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:10:11 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-4a301b5e-2596-4af7-a6b9-26f7cf85e2c4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.059937 Apr 18 16:10:11 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 16:10:11 2023] POST /compute/v2.1/flavors => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 16:10:11 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-05ec82a9-78c2-4e82-98ba-8b190469b3f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:10:11 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-05ec82a9-78c2-4e82-98ba-8b190469b3f7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045866 Apr 18 16:10:11 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 9/26] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 16:10:11 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:10:13 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-5291c461-8c0e-446c-abda-e3ff7b993080 admin admin] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:10:13 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-5291c461-8c0e-446c-abda-e3ff7b993080 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002093 Apr 18 16:10:13 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 10/27] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 16:10:13 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:10:13 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-38c3e045-df23-43d1-843c-6f48088874fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:10:13 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-38c3e045-df23-43d1-843c-6f48088874fd admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.067725 Apr 18 16:10:13 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 16:10:13 2023] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 16:10:13 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-f73c3a8b-231a-4230-8428-ab3c55c5723b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:10:13 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-f73c3a8b-231a-4230-8428-ab3c55c5723b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030174 Apr 18 16:10:13 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 10/29] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 16:10:13 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:10:15 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-5291c461-8c0e-446c-abda-e3ff7b993080 admin admin] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:10:15 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-5291c461-8c0e-446c-abda-e3ff7b993080 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001416 Apr 18 16:10:15 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 11/30] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 16:10:15 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:10:15 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-190e251d-7c76-42fd-bdff-a9bafc8e1ec1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "id": "4", "ram": 8192, "os-flavor-access:is_public": true}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:10:15 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-190e251d-7c76-42fd-bdff-a9bafc8e1ec1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.056377 Apr 18 16:10:15 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 16:10:15 2023] POST /compute/v2.1/flavors => generated 403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 16:10:15 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-f8f21e3d-b55a-42f3-8434-c1deed5d1625 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:10:15 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-f8f21e3d-b55a-42f3-8434-c1deed5d1625 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025084 Apr 18 16:10:15 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 11/32] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 16:10:15 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:10:17 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-5291c461-8c0e-446c-abda-e3ff7b993080 admin admin] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:10:17 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-5291c461-8c0e-446c-abda-e3ff7b993080 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001498 Apr 18 16:10:17 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 12/33] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 16:10:17 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:10:17 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-a0ba73d9-37cd-4996-8c6f-7608a71e0c34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:10:17 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-a0ba73d9-37cd-4996-8c6f-7608a71e0c34 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.060535 Apr 18 16:10:17 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 16:10:17 2023] POST /compute/v2.1/flavors => generated 406 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 18 16:10:17 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-b3b143e6-6794-421a-bba0-cd79605d6f56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:10:17 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-b3b143e6-6794-421a-bba0-cd79605d6f56 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028026 Apr 18 16:10:17 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 12/35] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 16:10:17 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:10:51 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-5291c461-8c0e-446c-abda-e3ff7b993080 admin admin] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:10:51 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-5291c461-8c0e-446c-abda-e3ff7b993080 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002577 Apr 18 16:10:51 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 13/36] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 16:10:51 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:10:51 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:10:51 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-a361c14a-4ceb-4e4f-b513-ae4abda0c656 admin admin] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:10:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a361c14a-4ceb-4e4f-b513-ae4abda0c656 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:10:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a361c14a-4ceb-4e4f-b513-ae4abda0c656 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:10:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a361c14a-4ceb-4e4f-b513-ae4abda0c656 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:10:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a361c14a-4ceb-4e4f-b513-ae4abda0c656 admin admin] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:10:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a361c14a-4ceb-4e4f-b513-ae4abda0c656 admin admin] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:10:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a361c14a-4ceb-4e4f-b513-ae4abda0c656 admin admin] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:10:51 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-a361c14a-4ceb-4e4f-b513-ae4abda0c656 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.091351 Apr 18 16:10:51 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Tue Apr 18 16:10:51 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 16:11:22 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-b3b143e6-6794-421a-bba0-cd79605d6f56 admin admin] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:11:22 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-b3b143e6-6794-421a-bba0-cd79605d6f56 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002090 Apr 18 16:11:22 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 13/38] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 16:11:22 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:11:22 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:11:22 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-cd3fbf1b-b076-49f8-b646-30489287a871 admin admin] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:11:22 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-cd3fbf1b-b076-49f8-b646-30489287a871 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.076653 Apr 18 16:11:22 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 14/39] 10.0.0.210 () {64 vars in 1367 bytes} [Tue Apr 18 16:11:22 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:11:27 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-a361c14a-4ceb-4e4f-b513-ae4abda0c656 admin admin] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:11:27 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-a361c14a-4ceb-4e4f-b513-ae4abda0c656 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001459 Apr 18 16:11:27 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 16:11:27 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:11:27 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:11:27 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-c19b13e6-b142-4f23-807e-f9f26430be9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.nano", "ram": 128, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "42"}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:11:27 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-c19b13e6-b142-4f23-807e-f9f26430be9c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.064322 Apr 18 16:11:27 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 14/41] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 18 16:11:27 2023] POST /compute/v2.1/flavors => generated 403 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 16:11:27 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-8bee8242-5c35-4ad3-a31b-a20c584a61d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:11:27 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-8bee8242-5c35-4ad3-a31b-a20c584a61d5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033470 Apr 18 16:11:27 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 15/42] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 18 16:11:27 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:11:31 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-a361c14a-4ceb-4e4f-b513-ae4abda0c656 admin admin] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:11:31 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-a361c14a-4ceb-4e4f-b513-ae4abda0c656 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002057 Apr 18 16:11:31 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 16:11:31 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:11:31 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-d218d3ea-f9ac-4a37-a652-91b951aa1353 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "84", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "name": "m1.micro", "ram": 192}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:11:31 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-d218d3ea-f9ac-4a37-a652-91b951aa1353 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.118693 Apr 18 16:11:31 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 15/44] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 18 16:11:31 2023] POST /compute/v2.1/flavors => generated 404 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 16:11:31 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-cf6c2110-4360-4751-a89c-abb1986ba297 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:11:31 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-cf6c2110-4360-4751-a89c-abb1986ba297 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027823 Apr 18 16:11:31 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 16/45] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 18 16:11:31 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:13:42 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:13:42 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:13:42 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=4 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:13:42 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-7f5529e1-3e8e-485e-a8ab-810bb1912fb8 tempest-VolumesSnapshotsTestJSON-206149404 tempest-VolumesSnapshotsTestJSON-206149404-project-member] Action: 'create', calling method: .version_select at 0x7fd6ca09ecb0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-926509564"}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:13:44 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-7f5529e1-3e8e-485e-a8ab-810bb1912fb8 tempest-VolumesSnapshotsTestJSON-206149404 tempest-VolumesSnapshotsTestJSON-206149404-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.705780 Apr 18 16:13:44 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Apr 18 16:13:42 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 1707 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 18 16:13:44 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:13:44 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-58fa7c28-d5f4-4083-a0ee-8d044d01b8c7 tempest-VolumesSnapshotsTestJSON-206149404 tempest-VolumesSnapshotsTestJSON-206149404-project-member] Calling method '.version_select at 0x7fd6ca015480>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:13:44 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-58fa7c28-d5f4-4083-a0ee-8d044d01b8c7 tempest-VolumesSnapshotsTestJSON-206149404 tempest-VolumesSnapshotsTestJSON-206149404-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a7ffa592-afc9-41f4-91c6-95559413dbd9" status: 200 len: 341 microversion: 2.1 time: 0.234766 Apr 18 16:13:44 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 16/47] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 16:13:44 2023] GET /compute/v2.1/os-volumes/a7ffa592-afc9-41f4-91c6-95559413dbd9 => generated 341 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:13:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-73c7052f-6e67-44a4-901d-2192a332b5c9 tempest-VolumesSnapshotsTestJSON-206149404 tempest-VolumesSnapshotsTestJSON-206149404-project-member] Calling method '.version_select at 0x7fd6ca003880>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:13:45 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:13:45 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-73c7052f-6e67-44a4-901d-2192a332b5c9 tempest-VolumesSnapshotsTestJSON-206149404 tempest-VolumesSnapshotsTestJSON-206149404-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a7ffa592-afc9-41f4-91c6-95559413dbd9" status: 200 len: 341 microversion: 2.1 time: 0.337074 Apr 18 16:13:45 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 17/48] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 16:13:45 2023] GET /compute/v2.1/os-volumes/a7ffa592-afc9-41f4-91c6-95559413dbd9 => generated 341 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:13:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-7cc971a5-7e81-4ded-879b-db5dac521521 tempest-VolumesSnapshotsTestJSON-206149404 tempest-VolumesSnapshotsTestJSON-206149404-project-member] Calling method '.version_select at 0x7fd6c9f24430>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:13:45 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-7cc971a5-7e81-4ded-879b-db5dac521521 tempest-VolumesSnapshotsTestJSON-206149404 tempest-VolumesSnapshotsTestJSON-206149404-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/a7ffa592-afc9-41f4-91c6-95559413dbd9" status: 202 len: 0 microversion: 2.1 time: 0.117862 Apr 18 16:13:45 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 16:13:45 2023] DELETE /compute/v2.1/os-volumes/a7ffa592-afc9-41f4-91c6-95559413dbd9 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:13:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-e3f2153c-ee7e-441f-a347-85ed87fadf1f tempest-VolumesSnapshotsTestJSON-206149404 tempest-VolumesSnapshotsTestJSON-206149404-project-member] Calling method '.version_select at 0x7fd6c9f2bf40>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:13:45 user devstack@n-api.service[61296]: INFO nova.api.openstack.wsgi [None req-e3f2153c-ee7e-441f-a347-85ed87fadf1f tempest-VolumesSnapshotsTestJSON-206149404 tempest-VolumesSnapshotsTestJSON-206149404-project-member] HTTP exception thrown: Volume a7ffa592-afc9-41f4-91c6-95559413dbd9 could not be found. Apr 18 16:13:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-e3f2153c-ee7e-441f-a347-85ed87fadf1f tempest-VolumesSnapshotsTestJSON-206149404 tempest-VolumesSnapshotsTestJSON-206149404-project-member] Request method failure captured: Apr 18 16:13:45 user devstack@n-api.service[61296]: request: GET /compute/v2.1/os-volumes/a7ffa592-afc9-41f4-91c6-95559413dbd9 HTTP/1.1 Apr 18 16:13:45 user devstack@n-api.service[61296]: Accept: application/json Apr 18 16:13:45 user devstack@n-api.service[61296]: Accept-Encoding: identity Apr 18 16:13:45 user devstack@n-api.service[61296]: Connection: close Apr 18 16:13:45 user devstack@n-api.service[61296]: Content-Length: 0 Apr 18 16:13:45 user devstack@n-api.service[61296]: Content-Type: application/json Apr 18 16:13:45 user devstack@n-api.service[61296]: Host: 10.0.0.210 Apr 18 16:13:45 user devstack@n-api.service[61296]: Openstack-System-Scope: None Apr 18 16:13:45 user devstack@n-api.service[61296]: User-Agent: python-urllib3/1.26.15 Apr 18 16:13:45 user devstack@n-api.service[61296]: X-Auth-Token: gAAAAABkPsG2Pok3AMmh9HwB2hThQiEqMFj-iQvAo_kPFuBO4S2m2YVbJ18lK2FNDacNvkMksivw7hwouBxpdb2dE0QQXKCX_KAUPD6teskZvjKinj13FhMT0DKkUKX-cC7Fw5IyiRMxGz6Tunv4eJHDeIUFQ8RAWLmh2KxHKcAjFCpWq0aKc7g Apr 18 16:13:45 user devstack@n-api.service[61296]: X-Domain-Id: None Apr 18 16:13:45 user devstack@n-api.service[61296]: X-Domain-Name: None Apr 18 16:13:45 user devstack@n-api.service[61296]: X-Identity-Status: Confirmed Apr 18 16:13:45 user devstack@n-api.service[61296]: X-Is-Admin-Project: True Apr 18 16:13:45 user devstack@n-api.service[61296]: X-Project-Domain-Id: default Apr 18 16:13:45 user devstack@n-api.service[61296]: X-Project-Domain-Name: Default Apr 18 16:13:45 user devstack@n-api.service[61296]: X-Project-Id: 9eebfa910ca141adb17c3c976cb59ffb Apr 18 16:13:45 user devstack@n-api.service[61296]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-206149404 Apr 18 16:13:45 user devstack@n-api.service[61296]: X-Role: reader,member Apr 18 16:13:45 user devstack@n-api.service[61296]: X-Roles: reader,member Apr 18 16:13:45 user devstack@n-api.service[61296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9eebfa910ca141adb17c3c976cb59ffb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9eebfa910ca141adb17c3c976cb59ffb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9eebfa910ca141adb17c3c976cb59ffb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:13:45 user devstack@n-api.service[61296]: X-Tenant: tempest-VolumesSnapshotsTestJSON-206149404 Apr 18 16:13:45 user devstack@n-api.service[61296]: X-Tenant-Id: 9eebfa910ca141adb17c3c976cb59ffb Apr 18 16:13:45 user devstack@n-api.service[61296]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-206149404 Apr 18 16:13:45 user devstack@n-api.service[61296]: X-User: tempest-VolumesSnapshotsTestJSON-206149404-project-member Apr 18 16:13:45 user devstack@n-api.service[61296]: X-User-Domain-Id: default Apr 18 16:13:45 user devstack@n-api.service[61296]: X-User-Domain-Name: Default Apr 18 16:13:45 user devstack@n-api.service[61296]: X-User-Id: 9ffea4e8d5bf4d099205e3727f8badd8 Apr 18 16:13:45 user devstack@n-api.service[61296]: X-User-Name: tempest-VolumesSnapshotsTestJSON-206149404-project-member Apr 18 16:13:45 user devstack@n-api.service[61296]: method: Apr 18 16:13:45 user devstack@n-api.service[61296]: exception: Volume a7ffa592-afc9-41f4-91c6-95559413dbd9 could not be found. Apr 18 16:13:45 user devstack@n-api.service[61296]: action_args: {'id': 'a7ffa592-afc9-41f4-91c6-95559413dbd9'} Apr 18 16:13:45 user devstack@n-api.service[61296]: {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a7ffa592-afc9-41f4-91c6-95559413dbd9 could not be found. (HTTP 404) (Request-ID: req-88e7c9d2-007a-4a3f-ba0a-bfa1e96f496e) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a7ffa592-afc9-41f4-91c6-95559413dbd9 could not be found. Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a7ffa592-afc9-41f4-91c6-95559413dbd9 could not be found. Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a7ffa592-afc9-41f4-91c6-95559413dbd9 could not be found. Apr 18 16:13:45 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:13:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-e3f2153c-ee7e-441f-a347-85ed87fadf1f tempest-VolumesSnapshotsTestJSON-206149404 tempest-VolumesSnapshotsTestJSON-206149404-project-member] Returning 404 to user: Volume a7ffa592-afc9-41f4-91c6-95559413dbd9 could not be found. {{(pid=61296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:13:45 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-e3f2153c-ee7e-441f-a347-85ed87fadf1f tempest-VolumesSnapshotsTestJSON-206149404 tempest-VolumesSnapshotsTestJSON-206149404-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a7ffa592-afc9-41f4-91c6-95559413dbd9" status: 404 len: 109 microversion: 2.1 time: 0.037839 Apr 18 16:13:45 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 17/50] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 16:13:45 2023] GET /compute/v2.1/os-volumes/a7ffa592-afc9-41f4-91c6-95559413dbd9 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:13:53 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-421490992", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "networks": [{"uuid": "16a8b366-68dd-415f-bae3-c01a7603f384"}]}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:13:53 user devstack@n-api.service[61295]: DEBUG nova.network.neutron [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] validate_networks() for [('16a8b366-68dd-415f-bae3-c01a7603f384', None, None, None, None, None)] {{(pid=61295) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:13:55 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Flavor limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:13:55 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Image limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:13:55 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Flavor pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:13:55 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Image pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:13:55 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:13:55 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:13:55 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:13:55 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:13:55 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:13:55 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:13:55 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:13:55 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Getting quotas for project eb907be282bb4348976527807993ee58. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:13:55 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Getting quotas for user 045e13d387f04d8eb0709154e4114bf5 and project eb907be282bb4348976527807993ee58. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:13:55 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Going to run 1 instances... {{(pid=61295) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:13:55 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] [instance: b9feb20a-78c0-44ac-ab87-3a68a14396aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:13:55 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-434b4276-b086-4dba-b8d2-6dbb1879a882 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.816698 Apr 18 16:13:55 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 18/51] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:13:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:13:55 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-70328d73-d05c-44bc-8cbb-6a891ee436ba tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:13:55 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-70328d73-d05c-44bc-8cbb-6a891ee436ba tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] [instance: b9feb20a-78c0-44ac-ab87-3a68a14396aa] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:13:55 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-70328d73-d05c-44bc-8cbb-6a891ee436ba tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045e13d387f04d8eb0709154e4114bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb907be282bb4348976527807993ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:13:55 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-70328d73-d05c-44bc-8cbb-6a891ee436ba tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9feb20a-78c0-44ac-ab87-3a68a14396aa" status: 200 len: 1208 microversion: 2.1 time: 0.165936 Apr 18 16:13:55 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:13:55 2023] GET /compute/v2.1/servers/b9feb20a-78c0-44ac-ab87-3a68a14396aa => generated 1208 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:13:57 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-b8b6620c-e470-4d66-a637-e40fceebc9d1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Action: 'create', calling method: .version_select at 0x7fd6c9f45630>, body: {"keypair": {"name": "tempest-keypair-228479226", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYfshyMt8uY2q2eUCQtkPkI3nGNlhhmmc9vp/6UdeXopca0J7dByvvp0JsnsKIVnxALXrFdF6MbHDsrQpV6fGcr4UECEAJuS6I1V5v6lY3+aDsuDcDzQvqgi06XGLFiPA=="}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:13:57 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-b8b6620c-e470-4d66-a637-e40fceebc9d1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Getting quotas for project caa61b19cc4e4cd4bb7d41291c40ef1f. Resources: {'key_pairs'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:13:57 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-b8b6620c-e470-4d66-a637-e40fceebc9d1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Getting quotas for user 07b7b9d8fdcf42f29e83e755f4f27380 and project caa61b19cc4e4cd4bb7d41291c40ef1f. Resources: {'key_pairs'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:13:57 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-b8b6620c-e470-4d66-a637-e40fceebc9d1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.364869 Apr 18 16:13:57 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 18/53] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 16:13:56 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:03 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1478486128", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:03 user devstack@n-api.service[61295]: DEBUG nova.network.neutron [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] validate_networks() for [('1bff5cf0-81ae-4bf0-88ab-fd844ee78e3f', None, None, None, None, None)] {{(pid=61295) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:14:04 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-23b18947-6df7-4dec-89ca-b4a30bb88745 req-5e7d85ca-96cc-4f15-a67a-5889b219cd6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9feb20a-78c0-44ac-ab87-3a68a14396aa", "tag": "cba845fa-9bbc-4e86-9fc9-f9458343fcc9"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-23b18947-6df7-4dec-89ca-b4a30bb88745 req-5e7d85ca-96cc-4f15-a67a-5889b219cd6b service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-23b18947-6df7-4dec-89ca-b4a30bb88745 req-5e7d85ca-96cc-4f15-a67a-5889b219cd6b service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-23b18947-6df7-4dec-89ca-b4a30bb88745 req-5e7d85ca-96cc-4f15-a67a-5889b219cd6b service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:04 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-23b18947-6df7-4dec-89ca-b4a30bb88745 req-5e7d85ca-96cc-4f15-a67a-5889b219cd6b service nova] Creating event network-changed:cba845fa-9bbc-4e86-9fc9-f9458343fcc9 for instance b9feb20a-78c0-44ac-ab87-3a68a14396aa on user Apr 18 16:14:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-23b18947-6df7-4dec-89ca-b4a30bb88745 req-5e7d85ca-96cc-4f15-a67a-5889b219cd6b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61294) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 16:14:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-23b18947-6df7-4dec-89ca-b4a30bb88745 req-5e7d85ca-96cc-4f15-a67a-5889b219cd6b service nova] Acquired lock "compute-rpcapi-router" {{(pid=61294) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 16:14:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-cb7c0f2a-b853-41ef-b410-13d150aeb11c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-cb7c0f2a-b853-41ef-b410-13d150aeb11c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-cb7c0f2a-b853-41ef-b410-13d150aeb11c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-cb7c0f2a-b853-41ef-b410-13d150aeb11c None None] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-cb7c0f2a-b853-41ef-b410-13d150aeb11c None None] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-cb7c0f2a-b853-41ef-b410-13d150aeb11c None None] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:04 user devstack@n-api.service[61294]: INFO nova.compute.rpcapi [None req-cb7c0f2a-b853-41ef-b410-13d150aeb11c None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 16:14:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-cb7c0f2a-b853-41ef-b410-13d150aeb11c None None] Releasing lock "compute-rpcapi-router" {{(pid=61294) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 16:14:04 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1074846308", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f5beaf4a-eeaf-454b-bde5-dd5e1f15e9dd"}], "security_groups": [{"name": "tempest-securitygroup--1616611598"}], "key_name": "tempest-keypair-228479226", "user_data": "}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:04 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-cb7c0f2a-b853-41ef-b410-13d150aeb11c None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218954 Apr 18 16:14:04 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 18/54] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 16:14:04 user devstack@n-api.service[61296]: DEBUG nova.network.neutron [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] validate_networks() for [('f5beaf4a-eeaf-454b-bde5-dd5e1f15e9dd', None, None, None, None, None)] {{(pid=61296) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:14:05 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:05 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:05 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=6 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:06 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Flavor limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:14:06 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Image limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:14:06 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Flavor pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:14:06 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Image pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:14:06 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Flavor limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Image limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Flavor pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Image pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:14:07 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:07 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:07 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:07 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:07 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:07 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Getting quotas for project 261e8ba82d9e4203917afb0241a3b4fc. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Getting quotas for user a8a3f45f9c6c431781fb582b8da22b0b and project 261e8ba82d9e4203917afb0241a3b4fc. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:14:07 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Getting quotas for project caa61b19cc4e4cd4bb7d41291c40ef1f. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:14:07 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Getting quotas for user 07b7b9d8fdcf42f29e83e755f4f27380 and project caa61b19cc4e4cd4bb7d41291c40ef1f. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Going to run 1 instances... {{(pid=61295) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:14:07 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Going to run 1 instances... {{(pid=61296) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: da82d905-1ca1-403d-9598-7561e69b9704] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:14:07 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:14:07 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-dde7154f-a2cf-49d1-9157-7ced6e66e06f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.933606 Apr 18 16:14:07 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 19/55] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:14:04 2023] POST /compute/v2.1/servers => generated 407 bytes in 2935 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:14:07 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:07 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-60c74ee2-175e-47f0-aaf6-39717b9dae13 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 3.875900 Apr 18 16:14:07 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-ec3adbb7-aef3-45b7-ab6a-0895538142cb tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:14:07 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-ec3adbb7-aef3-45b7-ab6a-0895538142cb tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:14:07 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 19/56] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:14:03 2023] POST /compute/v2.1/servers => generated 381 bytes in 3883 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:14:07 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-f5e4945b-abe6-4aec-a4d9-78ace9f54984 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:14:07 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-f5e4945b-abe6-4aec-a4d9-78ace9f54984 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: da82d905-1ca1-403d-9598-7561e69b9704] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:14:07 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-ec3adbb7-aef3-45b7-ab6a-0895538142cb tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b7b9d8fdcf42f29e83e755f4f27380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa61b19cc4e4cd4bb7d41291c40ef1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:14:07 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-ec3adbb7-aef3-45b7-ab6a-0895538142cb tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 200 len: 1232 microversion: 2.1 time: 0.103470 Apr 18 16:14:07 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:14:07 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 1232 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:14:07 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-f5e4945b-abe6-4aec-a4d9-78ace9f54984 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3f45f9c6c431781fb582b8da22b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261e8ba82d9e4203917afb0241a3b4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:14:07 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-f5e4945b-abe6-4aec-a4d9-78ace9f54984 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da82d905-1ca1-403d-9598-7561e69b9704" status: 200 len: 1216 microversion: 2.1 time: 0.200891 Apr 18 16:14:07 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 20/58] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:14:07 2023] GET /compute/v2.1/servers/da82d905-1ca1-403d-9598-7561e69b9704 => generated 1216 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1351031695", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:07 user devstack@n-api.service[61295]: DEBUG nova.network.neutron [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] validate_networks() for [('1bff5cf0-81ae-4bf0-88ab-fd844ee78e3f', None, None, None, None, None)] {{(pid=61295) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:14:09 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Flavor limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:14:09 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Image limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:14:09 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Flavor pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:14:09 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Image pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:14:09 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:14:09 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:09 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:09 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:09 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:09 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:09 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:09 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Getting quotas for project 261e8ba82d9e4203917afb0241a3b4fc. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:14:09 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Getting quotas for user a8a3f45f9c6c431781fb582b8da22b0b and project 261e8ba82d9e4203917afb0241a3b4fc. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:14:09 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Going to run 1 instances... {{(pid=61295) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:14:09 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: d7a293bf-a9bd-424e-ba11-bbed7dfea41c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:14:10 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-11ef488d-46c3-48cb-b234-0aa757927a21 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.422538 Apr 18 16:14:10 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 20/59] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:14:07 2023] POST /compute/v2.1/servers => generated 381 bytes in 2426 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:14:10 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-664d30df-19e1-40b5-a59a-c46a04ab3cca tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:14:10 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-664d30df-19e1-40b5-a59a-c46a04ab3cca tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: d7a293bf-a9bd-424e-ba11-bbed7dfea41c] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:14:10 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-4646cec8-e037-4dcd-9fd5-d6170e7f8451 req-1395282e-1aa7-4aa2-941f-671fe6bc230c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9feb20a-78c0-44ac-ab87-3a68a14396aa", "name": "network-vif-plugged", "status": "completed", "tag": "cba845fa-9bbc-4e86-9fc9-f9458343fcc9"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:10 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-4646cec8-e037-4dcd-9fd5-d6170e7f8451 req-1395282e-1aa7-4aa2-941f-671fe6bc230c service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:10 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-4646cec8-e037-4dcd-9fd5-d6170e7f8451 req-1395282e-1aa7-4aa2-941f-671fe6bc230c service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:10 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-4646cec8-e037-4dcd-9fd5-d6170e7f8451 req-1395282e-1aa7-4aa2-941f-671fe6bc230c service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:10 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-664d30df-19e1-40b5-a59a-c46a04ab3cca tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3f45f9c6c431781fb582b8da22b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261e8ba82d9e4203917afb0241a3b4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:14:10 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-4646cec8-e037-4dcd-9fd5-d6170e7f8451 req-1395282e-1aa7-4aa2-941f-671fe6bc230c service nova] Creating event network-vif-plugged:cba845fa-9bbc-4e86-9fc9-f9458343fcc9 for instance b9feb20a-78c0-44ac-ab87-3a68a14396aa on user Apr 18 16:14:10 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-664d30df-19e1-40b5-a59a-c46a04ab3cca tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c" status: 200 len: 1216 microversion: 2.1 time: 0.086921 Apr 18 16:14:10 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 21/60] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:14:10 2023] GET /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c => generated 1216 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:14:10 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-4646cec8-e037-4dcd-9fd5-d6170e7f8451 req-1395282e-1aa7-4aa2-941f-671fe6bc230c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144401 Apr 18 16:14:10 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 20/61] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:11 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-dbe97fe1-f5c1-49ea-80eb-b63e9872b025 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Action: 'create', calling method: .version_select at 0x7fd6c9f1f9a0>, body: {"keypair": {"name": "tempest-keypair-87186417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO/CLWqaabu1PPSB6IO5u9ZPRsbyk1aJTiCtDZZM4ehxz6NX8dqpiUe00Z9Nr+BHXqhNNOtIquxOnLmyxJxZVKgMQccZdSmpkhgpRi7hndOMSE64mNrbe1QQ/t5OUkS2w=="}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:11 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-dbe97fe1-f5c1-49ea-80eb-b63e9872b025 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Getting quotas for project 6b4e8d8797be4c0e91b1401538f2eba8. Resources: {'key_pairs'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:14:11 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-dbe97fe1-f5c1-49ea-80eb-b63e9872b025 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Getting quotas for user af90e17ec027463fa8793e8539c39e13 and project 6b4e8d8797be4c0e91b1401538f2eba8. Resources: {'key_pairs'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:14:11 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-dbe97fe1-f5c1-49ea-80eb-b63e9872b025 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.273268 Apr 18 16:14:11 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 21/62] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 16:14:11 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:12 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-3ad3e915-d973-45c7-b4e3-bf4dcb6fdbe1 req-63a936c5-2fd4-488b-a92f-54c8a881fa87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9feb20a-78c0-44ac-ab87-3a68a14396aa", "name": "network-vif-plugged", "status": "completed", "tag": "cba845fa-9bbc-4e86-9fc9-f9458343fcc9"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-3ad3e915-d973-45c7-b4e3-bf4dcb6fdbe1 req-63a936c5-2fd4-488b-a92f-54c8a881fa87 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-3ad3e915-d973-45c7-b4e3-bf4dcb6fdbe1 req-63a936c5-2fd4-488b-a92f-54c8a881fa87 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-3ad3e915-d973-45c7-b4e3-bf4dcb6fdbe1 req-63a936c5-2fd4-488b-a92f-54c8a881fa87 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:12 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-3ad3e915-d973-45c7-b4e3-bf4dcb6fdbe1 req-63a936c5-2fd4-488b-a92f-54c8a881fa87 service nova] Creating event network-vif-plugged:cba845fa-9bbc-4e86-9fc9-f9458343fcc9 for instance b9feb20a-78c0-44ac-ab87-3a68a14396aa on user Apr 18 16:14:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-3ad3e915-d973-45c7-b4e3-bf4dcb6fdbe1 req-63a936c5-2fd4-488b-a92f-54c8a881fa87 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61296) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 16:14:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-3ad3e915-d973-45c7-b4e3-bf4dcb6fdbe1 req-63a936c5-2fd4-488b-a92f-54c8a881fa87 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61296) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 16:14:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-5901a86d-26ce-4b2a-8936-4b39162cd652 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-5901a86d-26ce-4b2a-8936-4b39162cd652 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-5901a86d-26ce-4b2a-8936-4b39162cd652 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-5901a86d-26ce-4b2a-8936-4b39162cd652 None None] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-5901a86d-26ce-4b2a-8936-4b39162cd652 None None] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-5901a86d-26ce-4b2a-8936-4b39162cd652 None None] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:12 user devstack@n-api.service[61296]: INFO nova.compute.rpcapi [None req-5901a86d-26ce-4b2a-8936-4b39162cd652 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 16:14:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-5901a86d-26ce-4b2a-8936-4b39162cd652 None None] Releasing lock "compute-rpcapi-router" {{(pid=61296) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 16:14:12 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-5901a86d-26ce-4b2a-8936-4b39162cd652 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127340 Apr 18 16:14:12 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 22/63] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:13 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-b77b59d6-75ba-416a-90be-3973050f1e02 req-fae0d70d-e8d7-4f03-b5d3-75a755235cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da82d905-1ca1-403d-9598-7561e69b9704", "tag": "894e80db-f051-4b32-adc8-e3afa321eb34"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:13 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-b77b59d6-75ba-416a-90be-3973050f1e02 req-fae0d70d-e8d7-4f03-b5d3-75a755235cf4 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:13 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-b77b59d6-75ba-416a-90be-3973050f1e02 req-fae0d70d-e8d7-4f03-b5d3-75a755235cf4 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:13 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-b77b59d6-75ba-416a-90be-3973050f1e02 req-fae0d70d-e8d7-4f03-b5d3-75a755235cf4 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:13 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-b77b59d6-75ba-416a-90be-3973050f1e02 req-fae0d70d-e8d7-4f03-b5d3-75a755235cf4 service nova] Creating event network-changed:894e80db-f051-4b32-adc8-e3afa321eb34 for instance da82d905-1ca1-403d-9598-7561e69b9704 on user Apr 18 16:14:13 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-b77b59d6-75ba-416a-90be-3973050f1e02 req-fae0d70d-e8d7-4f03-b5d3-75a755235cf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039536 Apr 18 16:14:13 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 21/64] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:16 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-1de86017-8058-4f6e-ada5-00188ee43278 req-59f05442-88ba-43dd-8884-5b43c42d4961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da82d905-1ca1-403d-9598-7561e69b9704", "name": "network-vif-plugged", "status": "completed", "tag": "894e80db-f051-4b32-adc8-e3afa321eb34"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:16 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=10 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-1de86017-8058-4f6e-ada5-00188ee43278 req-59f05442-88ba-43dd-8884-5b43c42d4961 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-1de86017-8058-4f6e-ada5-00188ee43278 req-59f05442-88ba-43dd-8884-5b43c42d4961 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-1de86017-8058-4f6e-ada5-00188ee43278 req-59f05442-88ba-43dd-8884-5b43c42d4961 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:16 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-a5efd8f1-9042-4415-afa3-7880d2cabba5 req-00f5ca6f-de27-46ec-b2e1-0d68863f90f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a293bf-a9bd-424e-ba11-bbed7dfea41c", "tag": "e5d69d5c-1a5c-4300-ab15-e73f78388f0e"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:16 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-a5efd8f1-9042-4415-afa3-7880d2cabba5 req-00f5ca6f-de27-46ec-b2e1-0d68863f90f0 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:16 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-a5efd8f1-9042-4415-afa3-7880d2cabba5 req-00f5ca6f-de27-46ec-b2e1-0d68863f90f0 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:16 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-a5efd8f1-9042-4415-afa3-7880d2cabba5 req-00f5ca6f-de27-46ec-b2e1-0d68863f90f0 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:16 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-a5efd8f1-9042-4415-afa3-7880d2cabba5 req-00f5ca6f-de27-46ec-b2e1-0d68863f90f0 service nova] Creating event network-changed:e5d69d5c-1a5c-4300-ab15-e73f78388f0e for instance d7a293bf-a9bd-424e-ba11-bbed7dfea41c on user Apr 18 16:14:16 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-1de86017-8058-4f6e-ada5-00188ee43278 req-59f05442-88ba-43dd-8884-5b43c42d4961 service nova] Creating event network-vif-plugged:894e80db-f051-4b32-adc8-e3afa321eb34 for instance da82d905-1ca1-403d-9598-7561e69b9704 on user Apr 18 16:14:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-1de86017-8058-4f6e-ada5-00188ee43278 req-59f05442-88ba-43dd-8884-5b43c42d4961 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61295) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 16:14:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-1de86017-8058-4f6e-ada5-00188ee43278 req-59f05442-88ba-43dd-8884-5b43c42d4961 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61295) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 16:14:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ccb31adc-f3aa-435c-ac5a-a15dd5d6a7b7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ccb31adc-f3aa-435c-ac5a-a15dd5d6a7b7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ccb31adc-f3aa-435c-ac5a-a15dd5d6a7b7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ccb31adc-f3aa-435c-ac5a-a15dd5d6a7b7 None None] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ccb31adc-f3aa-435c-ac5a-a15dd5d6a7b7 None None] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ccb31adc-f3aa-435c-ac5a-a15dd5d6a7b7 None None] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:16 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-a5efd8f1-9042-4415-afa3-7880d2cabba5 req-00f5ca6f-de27-46ec-b2e1-0d68863f90f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058115 Apr 18 16:14:16 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 23/65] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:16 user devstack@n-api.service[61295]: INFO nova.compute.rpcapi [None req-ccb31adc-f3aa-435c-ac5a-a15dd5d6a7b7 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 16:14:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ccb31adc-f3aa-435c-ac5a-a15dd5d6a7b7 None None] Releasing lock "compute-rpcapi-router" {{(pid=61295) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 16:14:16 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-ccb31adc-f3aa-435c-ac5a-a15dd5d6a7b7 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140495 Apr 18 16:14:16 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 22/66] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 16:14:18 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:18 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:18 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-f9df61f1-0309-46cf-a640-5598e81e0ffc req-4c0c83e4-43cb-49f6-a440-d4469b16ad36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b530349-680e-4def-86ef-29c340efa175", "tag": "64d26c20-add4-4a63-bace-6a3678032692"}, {"server_uuid": "da82d905-1ca1-403d-9598-7561e69b9704", "name": "network-vif-plugged", "status": "completed", "tag": "894e80db-f051-4b32-adc8-e3afa321eb34"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:18 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-f9df61f1-0309-46cf-a640-5598e81e0ffc req-4c0c83e4-43cb-49f6-a440-d4469b16ad36 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:18 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-f9df61f1-0309-46cf-a640-5598e81e0ffc req-4c0c83e4-43cb-49f6-a440-d4469b16ad36 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:18 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-f9df61f1-0309-46cf-a640-5598e81e0ffc req-4c0c83e4-43cb-49f6-a440-d4469b16ad36 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:18 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-f9df61f1-0309-46cf-a640-5598e81e0ffc req-4c0c83e4-43cb-49f6-a440-d4469b16ad36 service nova] Creating event network-changed:64d26c20-add4-4a63-bace-6a3678032692 for instance 1b530349-680e-4def-86ef-29c340efa175 on user Apr 18 16:14:18 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-f9df61f1-0309-46cf-a640-5598e81e0ffc req-4c0c83e4-43cb-49f6-a440-d4469b16ad36 service nova] Creating event network-vif-plugged:894e80db-f051-4b32-adc8-e3afa321eb34 for instance da82d905-1ca1-403d-9598-7561e69b9704 on user Apr 18 16:14:18 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-f9df61f1-0309-46cf-a640-5598e81e0ffc req-4c0c83e4-43cb-49f6-a440-d4469b16ad36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.041376 Apr 18 16:14:18 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 22/67] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:18 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:19 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1278260269", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "02aca424-2923-404b-9c66-76bec89f82b7"}], "security_groups": [{"name": "tempest-securitygroup--945196493"}], "key_name": "tempest-keypair-87186417", "user_data": "}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:20 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=14 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:20 user devstack@n-api.service[61296]: DEBUG nova.network.neutron [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] validate_networks() for [('02aca424-2923-404b-9c66-76bec89f82b7', None, None, None, None, None)] {{(pid=61296) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:14:21 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-17d8bb86-55e0-4757-a02c-696c71ac3c3f req-8db9bfc9-ada0-4e3b-b122-8f7ea577f27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b530349-680e-4def-86ef-29c340efa175", "name": "network-vif-plugged", "status": "completed", "tag": "64d26c20-add4-4a63-bace-6a3678032692"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:21 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-17d8bb86-55e0-4757-a02c-696c71ac3c3f req-8db9bfc9-ada0-4e3b-b122-8f7ea577f27d service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:21 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-17d8bb86-55e0-4757-a02c-696c71ac3c3f req-8db9bfc9-ada0-4e3b-b122-8f7ea577f27d service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:21 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-17d8bb86-55e0-4757-a02c-696c71ac3c3f req-8db9bfc9-ada0-4e3b-b122-8f7ea577f27d service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:21 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-bb3d7774-b21f-4f6f-82c1-92bcc05a3505 req-cdcf5883-4058-4a9e-bdf4-9313ae926d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a293bf-a9bd-424e-ba11-bbed7dfea41c", "name": "network-vif-plugged", "status": "completed", "tag": "e5d69d5c-1a5c-4300-ab15-e73f78388f0e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:21 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-bb3d7774-b21f-4f6f-82c1-92bcc05a3505 req-cdcf5883-4058-4a9e-bdf4-9313ae926d9c service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:21 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-bb3d7774-b21f-4f6f-82c1-92bcc05a3505 req-cdcf5883-4058-4a9e-bdf4-9313ae926d9c service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:21 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-17d8bb86-55e0-4757-a02c-696c71ac3c3f req-8db9bfc9-ada0-4e3b-b122-8f7ea577f27d service nova] Creating event network-vif-plugged:64d26c20-add4-4a63-bace-6a3678032692 for instance 1b530349-680e-4def-86ef-29c340efa175 on user Apr 18 16:14:21 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-bb3d7774-b21f-4f6f-82c1-92bcc05a3505 req-cdcf5883-4058-4a9e-bdf4-9313ae926d9c service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:21 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-17d8bb86-55e0-4757-a02c-696c71ac3c3f req-8db9bfc9-ada0-4e3b-b122-8f7ea577f27d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194597 Apr 18 16:14:21 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-bb3d7774-b21f-4f6f-82c1-92bcc05a3505 req-cdcf5883-4058-4a9e-bdf4-9313ae926d9c service nova] Creating event network-vif-plugged:e5d69d5c-1a5c-4300-ab15-e73f78388f0e for instance d7a293bf-a9bd-424e-ba11-bbed7dfea41c on user Apr 18 16:14:21 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 23/68] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:21 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-bb3d7774-b21f-4f6f-82c1-92bcc05a3505 req-cdcf5883-4058-4a9e-bdf4-9313ae926d9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045204 Apr 18 16:14:21 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 23/69] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:21 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Flavor limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:14:21 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Image limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:14:21 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Flavor pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:14:21 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Image pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:14:21 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:14:22 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:22 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:22 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:22 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:22 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:22 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:22 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Getting quotas for project 6b4e8d8797be4c0e91b1401538f2eba8. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:14:22 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Getting quotas for user af90e17ec027463fa8793e8539c39e13 and project 6b4e8d8797be4c0e91b1401538f2eba8. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:14:22 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Going to run 1 instances... {{(pid=61296) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:14:22 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: 993d062c-8462-4534-bcde-9249779d4e90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:14:22 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-c0011d44-6dfa-4442-a2cb-51e16c960bcc tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 2.511521 Apr 18 16:14:22 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 24/70] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:14:19 2023] POST /compute/v2.1/servers => generated 399 bytes in 2513 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:14:22 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=16 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:22 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-c7792d1e-4ffb-406e-925f-5cc58032a8a7 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:14:22 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-c7792d1e-4ffb-406e-925f-5cc58032a8a7 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: 993d062c-8462-4534-bcde-9249779d4e90] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:14:22 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-c7792d1e-4ffb-406e-925f-5cc58032a8a7 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af90e17ec027463fa8793e8539c39e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4e8d8797be4c0e91b1401538f2eba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:14:22 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-c7792d1e-4ffb-406e-925f-5cc58032a8a7 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90" status: 200 len: 1234 microversion: 2.1 time: 0.176791 Apr 18 16:14:22 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 24/71] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:14:22 2023] GET /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90 => generated 1234 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:14:23 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-2630565b-281c-4e9a-8408-2e43131fe47b req-660b440b-c064-4a0c-a29f-935b63a1ed79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b530349-680e-4def-86ef-29c340efa175", "name": "network-vif-plugged", "status": "completed", "tag": "64d26c20-add4-4a63-bace-6a3678032692"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:23 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-2630565b-281c-4e9a-8408-2e43131fe47b req-660b440b-c064-4a0c-a29f-935b63a1ed79 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:23 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-2630565b-281c-4e9a-8408-2e43131fe47b req-660b440b-c064-4a0c-a29f-935b63a1ed79 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:23 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-2630565b-281c-4e9a-8408-2e43131fe47b req-660b440b-c064-4a0c-a29f-935b63a1ed79 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:23 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-ccae80fc-9645-46e6-92a7-107c59605b78 req-209fd942-01f7-4690-8eb8-9f77203c3320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a293bf-a9bd-424e-ba11-bbed7dfea41c", "name": "network-vif-plugged", "status": "completed", "tag": "e5d69d5c-1a5c-4300-ab15-e73f78388f0e"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:23 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-2630565b-281c-4e9a-8408-2e43131fe47b req-660b440b-c064-4a0c-a29f-935b63a1ed79 service nova] Creating event network-vif-plugged:64d26c20-add4-4a63-bace-6a3678032692 for instance 1b530349-680e-4def-86ef-29c340efa175 on user Apr 18 16:14:23 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-ccae80fc-9645-46e6-92a7-107c59605b78 req-209fd942-01f7-4690-8eb8-9f77203c3320 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:23 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-ccae80fc-9645-46e6-92a7-107c59605b78 req-209fd942-01f7-4690-8eb8-9f77203c3320 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:23 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-ccae80fc-9645-46e6-92a7-107c59605b78 req-209fd942-01f7-4690-8eb8-9f77203c3320 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:23 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-2630565b-281c-4e9a-8408-2e43131fe47b req-660b440b-c064-4a0c-a29f-935b63a1ed79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097071 Apr 18 16:14:23 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 24/72] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:23 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-ccae80fc-9645-46e6-92a7-107c59605b78 req-209fd942-01f7-4690-8eb8-9f77203c3320 service nova] Creating event network-vif-plugged:e5d69d5c-1a5c-4300-ab15-e73f78388f0e for instance d7a293bf-a9bd-424e-ba11-bbed7dfea41c on user Apr 18 16:14:23 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-ccae80fc-9645-46e6-92a7-107c59605b78 req-209fd942-01f7-4690-8eb8-9f77203c3320 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056813 Apr 18 16:14:23 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 25/73] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:31 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=6 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:31 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=10 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:31 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-8d86e153-0aca-498c-8d41-7902d09344c7 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Action: 'create', calling method: .version_select at 0x7fd6c962f910>, body: {"keypair": {"name": "tempest-keypair-566143322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONN6MRKRvMlP+yhMvoK61g7j3Fx5jQQ3LJcp2/nEL6Bw4QbghpzmZf4ISq5JqxxU2idrMJX8n+LTtOiGMui6w8KD50cE/dbEKkPZMqCi7adfHQOEiIsLKutmIbwwhmkFw=="}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:31 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-8d86e153-0aca-498c-8d41-7902d09344c7 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Getting quotas for project 8b357cc820a04f3486f98d8e38c1a3d6. Resources: {'key_pairs'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:14:31 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-8d86e153-0aca-498c-8d41-7902d09344c7 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Getting quotas for user ffaa9df682cb40739d1d754000e04743 and project 8b357cc820a04f3486f98d8e38c1a3d6. Resources: {'key_pairs'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:14:31 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-8d86e153-0aca-498c-8d41-7902d09344c7 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.257078 Apr 18 16:14:31 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 25/74] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 16:14:31 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:34 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=20 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:34 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=14 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:34 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-41f89b3c-a178-48a1-846d-dde105f193b3 req-20b65c34-9d73-41fe-a9cc-ae69903da943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993d062c-8462-4534-bcde-9249779d4e90", "tag": "fe3d4b7c-e19e-4931-8ac7-baad36fbf1b3"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:34 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-41f89b3c-a178-48a1-846d-dde105f193b3 req-20b65c34-9d73-41fe-a9cc-ae69903da943 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:34 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-41f89b3c-a178-48a1-846d-dde105f193b3 req-20b65c34-9d73-41fe-a9cc-ae69903da943 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:34 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-41f89b3c-a178-48a1-846d-dde105f193b3 req-20b65c34-9d73-41fe-a9cc-ae69903da943 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:34 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-41f89b3c-a178-48a1-846d-dde105f193b3 req-20b65c34-9d73-41fe-a9cc-ae69903da943 service nova] Creating event network-changed:fe3d4b7c-e19e-4931-8ac7-baad36fbf1b3 for instance 993d062c-8462-4534-bcde-9249779d4e90 on user Apr 18 16:14:34 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-41f89b3c-a178-48a1-846d-dde105f193b3 req-20b65c34-9d73-41fe-a9cc-ae69903da943 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040396 Apr 18 16:14:34 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 25/75] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:34 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=6 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:34 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=6 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:34 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=7 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:34 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=12 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:34 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-182924015", "imageRef": "2824808e-fd92-429e-ad00-18522a9ee7be", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "a8157d06-a7f6-4b9c-ae66-cd40da31eb6d"}], "security_groups": [{"name": "tempest-securitygroup--1305954992"}], "key_name": "tempest-keypair-566143322", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:34 user devstack@n-api.service[61296]: DEBUG nova.network.neutron [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] validate_networks() for [('a8157d06-a7f6-4b9c-ae66-cd40da31eb6d', None, None, None, None, None)] {{(pid=61296) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:14:35 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Flavor limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:14:35 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Image limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:14:35 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Flavor pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:14:35 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Image pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:14:35 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:14:35 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:35 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:35 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:35 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:35 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:35 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:35 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Getting quotas for project 8b357cc820a04f3486f98d8e38c1a3d6. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:14:35 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Getting quotas for user ffaa9df682cb40739d1d754000e04743 and project 8b357cc820a04f3486f98d8e38c1a3d6. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:14:35 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Going to run 1 instances... {{(pid=61296) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:14:35 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] [instance: aaac3797-349f-4695-bea2-8b0c022a66e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2824808e-fd92-429e-ad00-18522a9ee7be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:14:35 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-ab1e8281-d1dc-4121-bf74-0042d40b8e4f tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.067185 Apr 18 16:14:35 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 26/76] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:14:34 2023] POST /compute/v2.1/servers => generated 404 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:14:35 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-f5f08b10-ab5c-44f7-a2d5-ee49da85cebc tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:14:35 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-f5f08b10-ab5c-44f7-a2d5-ee49da85cebc tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] [instance: aaac3797-349f-4695-bea2-8b0c022a66e0] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:14:35 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-f5f08b10-ab5c-44f7-a2d5-ee49da85cebc tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffaa9df682cb40739d1d754000e04743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b357cc820a04f3486f98d8e38c1a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:14:35 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-f5f08b10-ab5c-44f7-a2d5-ee49da85cebc tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0" status: 200 len: 1238 microversion: 2.1 time: 0.131594 Apr 18 16:14:35 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 26/77] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:14:35 2023] GET /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0 => generated 1238 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:14:38 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-766b38dd-a7da-4794-953b-25d65ff73b3f req-1359f129-af7c-4af6-a38d-b0ed197131b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993d062c-8462-4534-bcde-9249779d4e90", "name": "network-vif-plugged", "status": "completed", "tag": "fe3d4b7c-e19e-4931-8ac7-baad36fbf1b3"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-766b38dd-a7da-4794-953b-25d65ff73b3f req-1359f129-af7c-4af6-a38d-b0ed197131b7 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-766b38dd-a7da-4794-953b-25d65ff73b3f req-1359f129-af7c-4af6-a38d-b0ed197131b7 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-766b38dd-a7da-4794-953b-25d65ff73b3f req-1359f129-af7c-4af6-a38d-b0ed197131b7 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:38 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-766b38dd-a7da-4794-953b-25d65ff73b3f req-1359f129-af7c-4af6-a38d-b0ed197131b7 service nova] Creating event network-vif-plugged:fe3d4b7c-e19e-4931-8ac7-baad36fbf1b3 for instance 993d062c-8462-4534-bcde-9249779d4e90 on user Apr 18 16:14:38 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-766b38dd-a7da-4794-953b-25d65ff73b3f req-1359f129-af7c-4af6-a38d-b0ed197131b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041646 Apr 18 16:14:38 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 26/78] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:38 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-de7dc291-3210-4146-9090-76fe0d7e361a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Action: 'create', calling method: .version_select at 0x7fd6c9ef7c70>, body: {"keypair": {"name": "tempest-keypair-1220171208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAniXSetAQE9Sn51zA8NpTX2dOiul2qACE7wlThUOvDLY/XUKayPw9h+boGYtqxwA3BNtZbXaC0adc4Uojp5kUY4JmnKz7unbT3y9taLOI+qBOXnUno++8x4d6lIizphZQ=="}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:38 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-de7dc291-3210-4146-9090-76fe0d7e361a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Getting quotas for project 8edf93a24e754e1ea58c0a7fd4f553dc. Resources: {'key_pairs'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:14:38 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-de7dc291-3210-4146-9090-76fe0d7e361a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Getting quotas for user 299ba2e202244f59a09e22df9ea8efe7 and project 8edf93a24e754e1ea58c0a7fd4f553dc. Resources: {'key_pairs'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:14:38 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-de7dc291-3210-4146-9090-76fe0d7e361a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.302221 Apr 18 16:14:38 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 27/79] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 16:14:38 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:40 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-30bf49db-a2a2-4864-ba64-3c5988686fbe req-d05317c7-9d94-4d7f-8215-45765fcb89ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993d062c-8462-4534-bcde-9249779d4e90", "name": "network-vif-plugged", "status": "completed", "tag": "fe3d4b7c-e19e-4931-8ac7-baad36fbf1b3"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:40 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-30bf49db-a2a2-4864-ba64-3c5988686fbe req-d05317c7-9d94-4d7f-8215-45765fcb89ce service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:40 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-30bf49db-a2a2-4864-ba64-3c5988686fbe req-d05317c7-9d94-4d7f-8215-45765fcb89ce service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:40 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-30bf49db-a2a2-4864-ba64-3c5988686fbe req-d05317c7-9d94-4d7f-8215-45765fcb89ce service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:40 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-30bf49db-a2a2-4864-ba64-3c5988686fbe req-d05317c7-9d94-4d7f-8215-45765fcb89ce service nova] Creating event network-vif-plugged:fe3d4b7c-e19e-4931-8ac7-baad36fbf1b3 for instance 993d062c-8462-4534-bcde-9249779d4e90 on user Apr 18 16:14:40 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-30bf49db-a2a2-4864-ba64-3c5988686fbe req-d05317c7-9d94-4d7f-8215-45765fcb89ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046469 Apr 18 16:14:40 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 27/80] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:41 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-370003702", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "networks": [{"uuid": "0fafa4bf-5d8d-43f9-8cc3-ae6e7c58812c"}], "security_groups": [{"name": "tempest-securitygroup--161166042"}], "key_name": "tempest-keypair-1220171208", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:42 user devstack@n-api.service[61294]: DEBUG nova.network.neutron [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] validate_networks() for [('0fafa4bf-5d8d-43f9-8cc3-ae6e7c58812c', None, None, None, None, None)] {{(pid=61294) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:14:42 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-ddd7be87-de64-434e-9ca1-c0a8b7735806 req-2627648f-205b-4f09-ab9a-f9df7c64b298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaac3797-349f-4695-bea2-8b0c022a66e0", "tag": "f2d5008c-284e-45a5-b349-4fe0723e138e"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-ddd7be87-de64-434e-9ca1-c0a8b7735806 req-2627648f-205b-4f09-ab9a-f9df7c64b298 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-ddd7be87-de64-434e-9ca1-c0a8b7735806 req-2627648f-205b-4f09-ab9a-f9df7c64b298 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-ddd7be87-de64-434e-9ca1-c0a8b7735806 req-2627648f-205b-4f09-ab9a-f9df7c64b298 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:42 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-ddd7be87-de64-434e-9ca1-c0a8b7735806 req-2627648f-205b-4f09-ab9a-f9df7c64b298 service nova] Creating event network-changed:f2d5008c-284e-45a5-b349-4fe0723e138e for instance aaac3797-349f-4695-bea2-8b0c022a66e0 on user Apr 18 16:14:42 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-ddd7be87-de64-434e-9ca1-c0a8b7735806 req-2627648f-205b-4f09-ab9a-f9df7c64b298 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041598 Apr 18 16:14:42 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 28/81] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:43 user devstack@n-api.service[61294]: DEBUG nova.virt.hardware [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Flavor limits 0:0:0 {{(pid=61294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:14:43 user devstack@n-api.service[61294]: DEBUG nova.virt.hardware [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Image limits 0:0:0 {{(pid=61294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:14:43 user devstack@n-api.service[61294]: DEBUG nova.virt.hardware [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Flavor pref 0:0:0 {{(pid=61294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:14:43 user devstack@n-api.service[61294]: DEBUG nova.virt.hardware [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Image pref 0:0:0 {{(pid=61294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:14:43 user devstack@n-api.service[61294]: DEBUG nova.virt.hardware [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:14:43 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:43 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:43 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:43 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:43 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:43 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:43 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Getting quotas for project 8edf93a24e754e1ea58c0a7fd4f553dc. Resources: {'cores', 'ram', 'instances'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:14:43 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Getting quotas for user 299ba2e202244f59a09e22df9ea8efe7 and project 8edf93a24e754e1ea58c0a7fd4f553dc. Resources: {'cores', 'ram', 'instances'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:14:43 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Going to run 1 instances... {{(pid=61294) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:14:43 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] [instance: 6c592508-0444-4b42-a0b5-e3d8bd97f5ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61294) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:14:43 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-9575af77-9ead-423f-a441-ea9893811782 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.874243 Apr 18 16:14:43 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 27/82] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:14:41 2023] POST /compute/v2.1/servers => generated 403 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:14:43 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-c5e5bcef-21d1-4720-bcd9-63b1bfb98a6a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:14:43 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-c5e5bcef-21d1-4720-bcd9-63b1bfb98a6a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] [instance: 6c592508-0444-4b42-a0b5-e3d8bd97f5ba] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:14:43 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-c5e5bcef-21d1-4720-bcd9-63b1bfb98a6a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299ba2e202244f59a09e22df9ea8efe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf93a24e754e1ea58c0a7fd4f553dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:14:43 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-c5e5bcef-21d1-4720-bcd9-63b1bfb98a6a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c592508-0444-4b42-a0b5-e3d8bd97f5ba" status: 200 len: 1235 microversion: 2.1 time: 0.078596 Apr 18 16:14:43 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 28/83] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:14:43 2023] GET /compute/v2.1/servers/6c592508-0444-4b42-a0b5-e3d8bd97f5ba => generated 1235 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:14:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-726fc0a7-87ad-487f-af8f-4a0c436ec9da tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:14:45 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-726fc0a7-87ad-487f-af8f-4a0c436ec9da tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] [instance: b9feb20a-78c0-44ac-ab87-3a68a14396aa] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:14:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-726fc0a7-87ad-487f-af8f-4a0c436ec9da tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-726fc0a7-87ad-487f-af8f-4a0c436ec9da tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-726fc0a7-87ad-487f-af8f-4a0c436ec9da tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-726fc0a7-87ad-487f-af8f-4a0c436ec9da tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-726fc0a7-87ad-487f-af8f-4a0c436ec9da tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-726fc0a7-87ad-487f-af8f-4a0c436ec9da tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:45 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-344e0525-b8a0-4866-a2db-72ba08cb376a req-b8d706da-c395-4dd1-bf95-988b42720e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaac3797-349f-4695-bea2-8b0c022a66e0", "name": "network-vif-plugged", "status": "completed", "tag": "f2d5008c-284e-45a5-b349-4fe0723e138e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:46 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-344e0525-b8a0-4866-a2db-72ba08cb376a req-b8d706da-c395-4dd1-bf95-988b42720e5b service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:46 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-344e0525-b8a0-4866-a2db-72ba08cb376a req-b8d706da-c395-4dd1-bf95-988b42720e5b service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:46 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-344e0525-b8a0-4866-a2db-72ba08cb376a req-b8d706da-c395-4dd1-bf95-988b42720e5b service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:46 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-344e0525-b8a0-4866-a2db-72ba08cb376a req-b8d706da-c395-4dd1-bf95-988b42720e5b service nova] Creating event network-vif-plugged:f2d5008c-284e-45a5-b349-4fe0723e138e for instance aaac3797-349f-4695-bea2-8b0c022a66e0 on user Apr 18 16:14:46 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-344e0525-b8a0-4866-a2db-72ba08cb376a req-b8d706da-c395-4dd1-bf95-988b42720e5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043226 Apr 18 16:14:46 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 28/84] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:46 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-726fc0a7-87ad-487f-af8f-4a0c436ec9da tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045e13d387f04d8eb0709154e4114bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb907be282bb4348976527807993ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:14:46 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-726fc0a7-87ad-487f-af8f-4a0c436ec9da tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9feb20a-78c0-44ac-ab87-3a68a14396aa" status: 200 len: 1489 microversion: 2.1 time: 0.978093 Apr 18 16:14:46 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 29/85] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:14:45 2023] GET /compute/v2.1/servers/b9feb20a-78c0-44ac-ab87-3a68a14396aa => generated 1489 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:14:48 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-44fc8817-5dab-41e7-a9e5-caaac7eadf0d req-9a11c995-a4d0-4e7d-9dbd-a1dc85638fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaac3797-349f-4695-bea2-8b0c022a66e0", "name": "network-vif-plugged", "status": "completed", "tag": "f2d5008c-284e-45a5-b349-4fe0723e138e"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:48 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-44fc8817-5dab-41e7-a9e5-caaac7eadf0d req-9a11c995-a4d0-4e7d-9dbd-a1dc85638fff service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-44fc8817-5dab-41e7-a9e5-caaac7eadf0d req-9a11c995-a4d0-4e7d-9dbd-a1dc85638fff service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-44fc8817-5dab-41e7-a9e5-caaac7eadf0d req-9a11c995-a4d0-4e7d-9dbd-a1dc85638fff service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:48 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-44fc8817-5dab-41e7-a9e5-caaac7eadf0d req-9a11c995-a4d0-4e7d-9dbd-a1dc85638fff service nova] Creating event network-vif-plugged:f2d5008c-284e-45a5-b349-4fe0723e138e for instance aaac3797-349f-4695-bea2-8b0c022a66e0 on user Apr 18 16:14:48 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-44fc8817-5dab-41e7-a9e5-caaac7eadf0d req-9a11c995-a4d0-4e7d-9dbd-a1dc85638fff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054724 Apr 18 16:14:48 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 29/86] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:49 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-aa4e1e5d-a0dc-4250-91ba-12c621fa670a tempest-TestShelveInstance-2049995338 tempest-TestShelveInstance-2049995338-project-member] Action: 'create', calling method: .version_select at 0x7fd6c967d870>, body: {"keypair": {"name": "tempest-TestShelveInstance-1689763313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHXBo0bZnZbwQRLN/JGbAq7d1gvxdEv2t/LmT6seC9S2Z1rFIF29sgGg8MmqFp4V88a93n6M/DfqQoBFrS8MWZo+P5f4wq3xzArdJvsfFEtMufJCs/kvijVlONjOOQe8A=="}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:49 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-aa4e1e5d-a0dc-4250-91ba-12c621fa670a tempest-TestShelveInstance-2049995338 tempest-TestShelveInstance-2049995338-project-member] Getting quotas for project ac26d2fd477f44ca8f837882be44e386. Resources: {'key_pairs'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:14:49 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-aa4e1e5d-a0dc-4250-91ba-12c621fa670a tempest-TestShelveInstance-2049995338 tempest-TestShelveInstance-2049995338-project-member] Getting quotas for user f8205f54a0e2479e8441bdd6949790f6 and project ac26d2fd477f44ca8f837882be44e386. Resources: {'key_pairs'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:14:49 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-aa4e1e5d-a0dc-4250-91ba-12c621fa670a tempest-TestShelveInstance-2049995338 tempest-TestShelveInstance-2049995338-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.279691 Apr 18 16:14:49 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 29/87] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 16:14:49 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:50 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=10 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:50 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-3a6aed1e-aa97-402c-a4fd-281ac59d7b34 req-f8ce8192-a200-4464-bbf9-05da117ca2bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c592508-0444-4b42-a0b5-e3d8bd97f5ba", "tag": "395afd81-e898-47ee-a928-eaab584d5b4e"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-3a6aed1e-aa97-402c-a4fd-281ac59d7b34 req-f8ce8192-a200-4464-bbf9-05da117ca2bd service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-3a6aed1e-aa97-402c-a4fd-281ac59d7b34 req-f8ce8192-a200-4464-bbf9-05da117ca2bd service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-3a6aed1e-aa97-402c-a4fd-281ac59d7b34 req-f8ce8192-a200-4464-bbf9-05da117ca2bd service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:50 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-3a6aed1e-aa97-402c-a4fd-281ac59d7b34 req-f8ce8192-a200-4464-bbf9-05da117ca2bd service nova] Creating event network-changed:395afd81-e898-47ee-a928-eaab584d5b4e for instance 6c592508-0444-4b42-a0b5-e3d8bd97f5ba on user Apr 18 16:14:50 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-3a6aed1e-aa97-402c-a4fd-281ac59d7b34 req-f8ce8192-a200-4464-bbf9-05da117ca2bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037217 Apr 18 16:14:50 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 30/88] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:52 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-6bc12126-972a-4fc3-b8c9-e054ea4fa96c req-ba645231-198b-4564-a2ad-41002e154b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c592508-0444-4b42-a0b5-e3d8bd97f5ba", "name": "network-vif-plugged", "status": "completed", "tag": "395afd81-e898-47ee-a928-eaab584d5b4e"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-6bc12126-972a-4fc3-b8c9-e054ea4fa96c req-ba645231-198b-4564-a2ad-41002e154b6d service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-6bc12126-972a-4fc3-b8c9-e054ea4fa96c req-ba645231-198b-4564-a2ad-41002e154b6d service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-6bc12126-972a-4fc3-b8c9-e054ea4fa96c req-ba645231-198b-4564-a2ad-41002e154b6d service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:52 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-6bc12126-972a-4fc3-b8c9-e054ea4fa96c req-ba645231-198b-4564-a2ad-41002e154b6d service nova] Creating event network-vif-plugged:395afd81-e898-47ee-a928-eaab584d5b4e for instance 6c592508-0444-4b42-a0b5-e3d8bd97f5ba on user Apr 18 16:14:52 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-6bc12126-972a-4fc3-b8c9-e054ea4fa96c req-ba645231-198b-4564-a2ad-41002e154b6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052222 Apr 18 16:14:52 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 30/89] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:54 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:54 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-1fa6a9e0-d0ce-4661-bb7d-4bf1428e9eae tempest-TestShelveInstance-2049995338 tempest-TestShelveInstance-2049995338-project-member] Calling method '.version_select at 0x7fd6c967cdc0>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:14:54 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-1fa6a9e0-d0ce-4661-bb7d-4bf1428e9eae tempest-TestShelveInstance-2049995338 tempest-TestShelveInstance-2049995338-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1689763313" status: 202 len: 0 microversion: 2.1 time: 0.035029 Apr 18 16:14:54 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 30/90] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Apr 18 16:14:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1689763313 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:14:54 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-ea92ccec-fae2-4941-86e3-907f123e8968 req-ee9ed0f5-b806-4cc7-9344-8cc20f7f6f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c592508-0444-4b42-a0b5-e3d8bd97f5ba", "name": "network-vif-plugged", "status": "completed", "tag": "395afd81-e898-47ee-a928-eaab584d5b4e"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:54 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-ea92ccec-fae2-4941-86e3-907f123e8968 req-ee9ed0f5-b806-4cc7-9344-8cc20f7f6f29 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:54 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-ea92ccec-fae2-4941-86e3-907f123e8968 req-ee9ed0f5-b806-4cc7-9344-8cc20f7f6f29 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:54 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-ea92ccec-fae2-4941-86e3-907f123e8968 req-ee9ed0f5-b806-4cc7-9344-8cc20f7f6f29 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:54 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-ea92ccec-fae2-4941-86e3-907f123e8968 req-ee9ed0f5-b806-4cc7-9344-8cc20f7f6f29 service nova] Creating event network-vif-plugged:395afd81-e898-47ee-a928-eaab584d5b4e for instance 6c592508-0444-4b42-a0b5-e3d8bd97f5ba on user Apr 18 16:14:54 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-ea92ccec-fae2-4941-86e3-907f123e8968 req-ee9ed0f5-b806-4cc7-9344-8cc20f7f6f29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050583 Apr 18 16:14:54 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 31/91] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:14:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:14:55 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=10 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:56 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-89fa607a-9800-4887-9e92-5e68db23010c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Action: 'create', calling method: .version_select at 0x7fd6c9ff7010>, body: {"keypair": {"name": "tempest-keypair-1312731460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNl9658QV9oAyWsF+PCDoKNB8f2Ysl88swP+0slbqtbCbBmKteLMBpQfjt+1JvV5krJu0v93BvOWlct8ODb6udN1fTuqEBomWxKiKxQ9Jd2pVu6lIa5zb/YgKK7JjSPmQ=="}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:56 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-89fa607a-9800-4887-9e92-5e68db23010c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Getting quotas for project d82a93c1cb9b4a4da7114874ddf0aa27. Resources: {'key_pairs'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:14:56 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-89fa607a-9800-4887-9e92-5e68db23010c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Getting quotas for user fd46686fd5b845cca0f3d9452a86f4ca and project d82a93c1cb9b4a4da7114874ddf0aa27. Resources: {'key_pairs'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:14:56 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-89fa607a-9800-4887-9e92-5e68db23010c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.192120 Apr 18 16:14:56 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 31/92] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 16:14:55 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 16:14:57 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=8 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:14:57 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-df9156b1-eb55-4ce7-8bef-86d73daae99f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:14:57 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-df9156b1-eb55-4ce7-8bef-86d73daae99f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:14:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-df9156b1-eb55-4ce7-8bef-86d73daae99f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-df9156b1-eb55-4ce7-8bef-86d73daae99f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-df9156b1-eb55-4ce7-8bef-86d73daae99f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-df9156b1-eb55-4ce7-8bef-86d73daae99f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-df9156b1-eb55-4ce7-8bef-86d73daae99f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-df9156b1-eb55-4ce7-8bef-86d73daae99f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:57 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-df9156b1-eb55-4ce7-8bef-86d73daae99f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b7b9d8fdcf42f29e83e755f4f27380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa61b19cc4e4cd4bb7d41291c40ef1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:14:57 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-df9156b1-eb55-4ce7-8bef-86d73daae99f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 200 len: 1539 microversion: 2.1 time: 0.480127 Apr 18 16:14:57 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 31/93] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:14:57 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 1539 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:14:58 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1897500495", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7f49a051-667b-4e91-80de-f4bbf2d6f09e"}], "security_groups": [{"name": "tempest-securitygroup--1043391400"}], "key_name": "tempest-keypair-1312731460", "user_data": "}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:14:58 user devstack@n-api.service[61296]: DEBUG nova.network.neutron [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] validate_networks() for [('7f49a051-667b-4e91-80de-f4bbf2d6f09e', None, None, None, None, None)] {{(pid=61296) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:14:59 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Flavor limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:14:59 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Image limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:14:59 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Flavor pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:14:59 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Image pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:14:59 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:14:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:14:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:14:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:14:59 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Getting quotas for project d82a93c1cb9b4a4da7114874ddf0aa27. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:14:59 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Getting quotas for user fd46686fd5b845cca0f3d9452a86f4ca and project d82a93c1cb9b4a4da7114874ddf0aa27. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:14:59 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Going to run 1 instances... {{(pid=61296) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:14:59 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:14:59 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-3d264582-b94d-46c4-b575-32c05d164bdc tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.774786 Apr 18 16:14:59 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 32/94] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:14:58 2023] POST /compute/v2.1/servers => generated 400 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:14:59 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-ff4f2b79-6421-43ff-aa91-230e8ee09d4f tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:14:59 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-ff4f2b79-6421-43ff-aa91-230e8ee09d4f tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:14:59 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-ff4f2b79-6421-43ff-aa91-230e8ee09d4f tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd46686fd5b845cca0f3d9452a86f4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82a93c1cb9b4a4da7114874ddf0aa27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:14:59 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-ff4f2b79-6421-43ff-aa91-230e8ee09d4f tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c" status: 200 len: 1232 microversion: 2.1 time: 0.117580 Apr 18 16:14:59 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 32/95] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:14:59 2023] GET /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c => generated 1232 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:15:00 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-c1924005-cd61-480b-9e7f-38569a127be9 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:15:00 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-c1924005-cd61-480b-9e7f-38569a127be9 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: d7a293bf-a9bd-424e-ba11-bbed7dfea41c] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:15:00 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=10 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:00 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c1924005-cd61-480b-9e7f-38569a127be9 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:00 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c1924005-cd61-480b-9e7f-38569a127be9 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:00 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c1924005-cd61-480b-9e7f-38569a127be9 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:00 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c1924005-cd61-480b-9e7f-38569a127be9 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:00 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c1924005-cd61-480b-9e7f-38569a127be9 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:00 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c1924005-cd61-480b-9e7f-38569a127be9 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:00 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-c1924005-cd61-480b-9e7f-38569a127be9 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3f45f9c6c431781fb582b8da22b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261e8ba82d9e4203917afb0241a3b4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:15:00 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-c1924005-cd61-480b-9e7f-38569a127be9 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c" status: 200 len: 1505 microversion: 2.1 time: 0.549162 Apr 18 16:15:00 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 32/96] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:15:00 2023] GET /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c => generated 1505 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:15:01 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-fbc803aa-d7bc-4a07-9533-fea1efe45c2d tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Action: 'create', calling method: .version_select at 0x7fd6c955c670>, body: {"keypair": {"name": "tempest-keypair-1985020567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRdR0cjFHm3mhHSll5gh7yZMFO8YnbHGZrzqn4BUKzi/NqN6epqJPxISmge123Mh6ultuf3msUKM4SPDGPvR5esoWMysquk2JzsFDlVx2V3n3YOLa1rlzu338dq4Z9bHg=="}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:15:01 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-fbc803aa-d7bc-4a07-9533-fea1efe45c2d tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Getting quotas for project e6fc24a9e1b646a2a08df4f53f712267. Resources: {'key_pairs'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:15:01 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-fbc803aa-d7bc-4a07-9533-fea1efe45c2d tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Getting quotas for user 6a284b1ad50e463894f8d58d38a57d7c and project e6fc24a9e1b646a2a08df4f53f712267. Resources: {'key_pairs'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:15:01 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-fbc803aa-d7bc-4a07-9533-fea1efe45c2d tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.202174 Apr 18 16:15:01 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 33/97] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 16:15:01 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:15:03 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1796838032", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "networks": [{"uuid": "7692c2b5-931d-4d1d-aae6-384ce4ff5ff0"}], "security_groups": [{"name": "tempest-securitygroup--839623665"}], "key_name": "tempest-keypair-1985020567", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:15:03 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=6 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:03 user devstack@n-api.service[61295]: DEBUG nova.network.neutron [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] validate_networks() for [('7692c2b5-931d-4d1d-aae6-384ce4ff5ff0', None, None, None, None, None)] {{(pid=61295) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:15:04 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-8c63780b-ab90-4826-ad9a-079134bda1fc req-bbba338a-995d-4a17-9c07-bc65bf6bbaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e1ccfc5-90a7-443f-83e2-c07be27d6c7c", "tag": "13606f1d-602f-4c77-b90b-32322653e54e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:15:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-8c63780b-ab90-4826-ad9a-079134bda1fc req-bbba338a-995d-4a17-9c07-bc65bf6bbaf8 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-8c63780b-ab90-4826-ad9a-079134bda1fc req-bbba338a-995d-4a17-9c07-bc65bf6bbaf8 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-8c63780b-ab90-4826-ad9a-079134bda1fc req-bbba338a-995d-4a17-9c07-bc65bf6bbaf8 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:04 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-8c63780b-ab90-4826-ad9a-079134bda1fc req-bbba338a-995d-4a17-9c07-bc65bf6bbaf8 service nova] Creating event network-changed:13606f1d-602f-4c77-b90b-32322653e54e for instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c on user Apr 18 16:15:04 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-8c63780b-ab90-4826-ad9a-079134bda1fc req-bbba338a-995d-4a17-9c07-bc65bf6bbaf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030186 Apr 18 16:15:04 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 33/98] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:15:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:15:04 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Flavor limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:15:04 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Image limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:15:04 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Flavor pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:15:04 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Image pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:15:04 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:15:04 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:04 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:04 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:04 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:04 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:04 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:04 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Getting quotas for project e6fc24a9e1b646a2a08df4f53f712267. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:15:04 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Getting quotas for user 6a284b1ad50e463894f8d58d38a57d7c and project e6fc24a9e1b646a2a08df4f53f712267. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:15:04 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Going to run 1 instances... {{(pid=61295) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:15:04 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] [instance: 8aaa4e97-9439-4760-9e05-8b248b02074f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:15:04 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-4bd53016-676b-4566-b265-a7991ed52055 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.079352 Apr 18 16:15:04 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 33/99] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:15:03 2023] POST /compute/v2.1/servers => generated 403 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:15:04 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-a35c057d-b55b-402d-8ca0-718b0d8febfb tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:15:04 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-a35c057d-b55b-402d-8ca0-718b0d8febfb tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] [instance: 8aaa4e97-9439-4760-9e05-8b248b02074f] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:15:04 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=8 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:04 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-a35c057d-b55b-402d-8ca0-718b0d8febfb tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a284b1ad50e463894f8d58d38a57d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fc24a9e1b646a2a08df4f53f712267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:15:04 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-a35c057d-b55b-402d-8ca0-718b0d8febfb tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f" status: 200 len: 1240 microversion: 2.1 time: 0.085350 Apr 18 16:15:04 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 34/100] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:15:04 2023] GET /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:15:06 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-1d14f48a-e8f0-41f9-9395-5385d1d2217f req-82b49ad2-e755-46ad-9131-245ccb89288c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e1ccfc5-90a7-443f-83e2-c07be27d6c7c", "name": "network-vif-plugged", "status": "completed", "tag": "13606f1d-602f-4c77-b90b-32322653e54e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:15:06 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-1d14f48a-e8f0-41f9-9395-5385d1d2217f req-82b49ad2-e755-46ad-9131-245ccb89288c service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:06 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-1d14f48a-e8f0-41f9-9395-5385d1d2217f req-82b49ad2-e755-46ad-9131-245ccb89288c service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:06 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-1d14f48a-e8f0-41f9-9395-5385d1d2217f req-82b49ad2-e755-46ad-9131-245ccb89288c service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:06 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-1d14f48a-e8f0-41f9-9395-5385d1d2217f req-82b49ad2-e755-46ad-9131-245ccb89288c service nova] Creating event network-vif-plugged:13606f1d-602f-4c77-b90b-32322653e54e for instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c on user Apr 18 16:15:06 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-1d14f48a-e8f0-41f9-9395-5385d1d2217f req-82b49ad2-e755-46ad-9131-245ccb89288c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048623 Apr 18 16:15:06 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 34/101] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:15:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:15:07 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-e769d872-bd6d-48a1-ae5e-f0493a7bc3e6 req-6b7a0d93-74a2-4e15-abbc-6b023bd42c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aaa4e97-9439-4760-9e05-8b248b02074f", "tag": "8029e455-c16d-48cd-93e1-cf56c226cc4a"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:15:07 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-e769d872-bd6d-48a1-ae5e-f0493a7bc3e6 req-6b7a0d93-74a2-4e15-abbc-6b023bd42c68 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:07 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-e769d872-bd6d-48a1-ae5e-f0493a7bc3e6 req-6b7a0d93-74a2-4e15-abbc-6b023bd42c68 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:07 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-e769d872-bd6d-48a1-ae5e-f0493a7bc3e6 req-6b7a0d93-74a2-4e15-abbc-6b023bd42c68 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:07 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-e769d872-bd6d-48a1-ae5e-f0493a7bc3e6 req-6b7a0d93-74a2-4e15-abbc-6b023bd42c68 service nova] Creating event network-changed:8029e455-c16d-48cd-93e1-cf56c226cc4a for instance 8aaa4e97-9439-4760-9e05-8b248b02074f on user Apr 18 16:15:07 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-e769d872-bd6d-48a1-ae5e-f0493a7bc3e6 req-6b7a0d93-74a2-4e15-abbc-6b023bd42c68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032637 Apr 18 16:15:07 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 34/102] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:15:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:15:08 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-8fa8ac4f-587b-4757-bb53-321acf0f143f req-d803acdf-6840-4530-af28-afa6732cdfa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e1ccfc5-90a7-443f-83e2-c07be27d6c7c", "name": "network-vif-plugged", "status": "completed", "tag": "13606f1d-602f-4c77-b90b-32322653e54e"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:15:08 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-8fa8ac4f-587b-4757-bb53-321acf0f143f req-d803acdf-6840-4530-af28-afa6732cdfa8 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:08 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-8fa8ac4f-587b-4757-bb53-321acf0f143f req-d803acdf-6840-4530-af28-afa6732cdfa8 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:08 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-8fa8ac4f-587b-4757-bb53-321acf0f143f req-d803acdf-6840-4530-af28-afa6732cdfa8 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:08 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=17 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:08 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-8fa8ac4f-587b-4757-bb53-321acf0f143f req-d803acdf-6840-4530-af28-afa6732cdfa8 service nova] Creating event network-vif-plugged:13606f1d-602f-4c77-b90b-32322653e54e for instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c on user Apr 18 16:15:08 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-8fa8ac4f-587b-4757-bb53-321acf0f143f req-d803acdf-6840-4530-af28-afa6732cdfa8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.372736 Apr 18 16:15:08 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 35/103] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:15:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:15:09 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-b89af778-b73d-43a4-81c9-da793618b697 req-a697563e-2173-4fad-988c-8a3c5d27ba9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aaa4e97-9439-4760-9e05-8b248b02074f", "name": "network-vif-plugged", "status": "completed", "tag": "8029e455-c16d-48cd-93e1-cf56c226cc4a"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:15:09 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:09 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-b89af778-b73d-43a4-81c9-da793618b697 req-a697563e-2173-4fad-988c-8a3c5d27ba9b service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:09 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-b89af778-b73d-43a4-81c9-da793618b697 req-a697563e-2173-4fad-988c-8a3c5d27ba9b service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:09 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-b89af778-b73d-43a4-81c9-da793618b697 req-a697563e-2173-4fad-988c-8a3c5d27ba9b service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:09 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-b89af778-b73d-43a4-81c9-da793618b697 req-a697563e-2173-4fad-988c-8a3c5d27ba9b service nova] Creating event network-vif-plugged:8029e455-c16d-48cd-93e1-cf56c226cc4a for instance 8aaa4e97-9439-4760-9e05-8b248b02074f on user Apr 18 16:15:09 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-b89af778-b73d-43a4-81c9-da793618b697 req-a697563e-2173-4fad-988c-8a3c5d27ba9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058577 Apr 18 16:15:09 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 35/104] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:15:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:15:11 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-b5114c83-f5f1-4ee6-8709-23ecb3330295 req-cc3a6c95-9677-4c86-9b1e-4cbb3dff16dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aaa4e97-9439-4760-9e05-8b248b02074f", "name": "network-vif-plugged", "status": "completed", "tag": "8029e455-c16d-48cd-93e1-cf56c226cc4a"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:15:11 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-b5114c83-f5f1-4ee6-8709-23ecb3330295 req-cc3a6c95-9677-4c86-9b1e-4cbb3dff16dc service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:11 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-b5114c83-f5f1-4ee6-8709-23ecb3330295 req-cc3a6c95-9677-4c86-9b1e-4cbb3dff16dc service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:11 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-b5114c83-f5f1-4ee6-8709-23ecb3330295 req-cc3a6c95-9677-4c86-9b1e-4cbb3dff16dc service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:11 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-b5114c83-f5f1-4ee6-8709-23ecb3330295 req-cc3a6c95-9677-4c86-9b1e-4cbb3dff16dc service nova] Creating event network-vif-plugged:8029e455-c16d-48cd-93e1-cf56c226cc4a for instance 8aaa4e97-9439-4760-9e05-8b248b02074f on user Apr 18 16:15:11 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-b5114c83-f5f1-4ee6-8709-23ecb3330295 req-cc3a6c95-9677-4c86-9b1e-4cbb3dff16dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046357 Apr 18 16:15:11 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 35/105] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:15:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:15:12 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:12 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-63a3321d-1d66-442f-a3fb-ce54a486c351 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:15:12 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-63a3321d-1d66-442f-a3fb-ce54a486c351 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: 993d062c-8462-4534-bcde-9249779d4e90] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:15:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-63a3321d-1d66-442f-a3fb-ce54a486c351 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-63a3321d-1d66-442f-a3fb-ce54a486c351 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-63a3321d-1d66-442f-a3fb-ce54a486c351 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-63a3321d-1d66-442f-a3fb-ce54a486c351 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-63a3321d-1d66-442f-a3fb-ce54a486c351 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-63a3321d-1d66-442f-a3fb-ce54a486c351 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:12 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-63a3321d-1d66-442f-a3fb-ce54a486c351 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af90e17ec027463fa8793e8539c39e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4e8d8797be4c0e91b1401538f2eba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:15:12 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-63a3321d-1d66-442f-a3fb-ce54a486c351 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90" status: 200 len: 1543 microversion: 2.1 time: 0.247517 Apr 18 16:15:12 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 36/106] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:15:12 2023] GET /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90 => generated 1543 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:15:25 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=18 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:25 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-5bd6efcc-72f8-47cf-90e2-c4b50c24a82a tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:15:25 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-5bd6efcc-72f8-47cf-90e2-c4b50c24a82a tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] [instance: aaac3797-349f-4695-bea2-8b0c022a66e0] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:15:25 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5bd6efcc-72f8-47cf-90e2-c4b50c24a82a tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:25 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5bd6efcc-72f8-47cf-90e2-c4b50c24a82a tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:25 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5bd6efcc-72f8-47cf-90e2-c4b50c24a82a tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:25 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5bd6efcc-72f8-47cf-90e2-c4b50c24a82a tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:25 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5bd6efcc-72f8-47cf-90e2-c4b50c24a82a tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:25 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5bd6efcc-72f8-47cf-90e2-c4b50c24a82a tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:25 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-5bd6efcc-72f8-47cf-90e2-c4b50c24a82a tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffaa9df682cb40739d1d754000e04743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b357cc820a04f3486f98d8e38c1a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:15:25 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-5bd6efcc-72f8-47cf-90e2-c4b50c24a82a tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0" status: 200 len: 1548 microversion: 2.1 time: 0.226336 Apr 18 16:15:25 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 36/107] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:15:25 2023] GET /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0 => generated 1548 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:15:33 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:33 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=12 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:33 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=4 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:33 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=6 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:33 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-e3c5de56-cabb-47de-92c8-74d64062f101 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:15:33 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-e3c5de56-cabb-47de-92c8-74d64062f101 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] [instance: 6c592508-0444-4b42-a0b5-e3d8bd97f5ba] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:15:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e3c5de56-cabb-47de-92c8-74d64062f101 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e3c5de56-cabb-47de-92c8-74d64062f101 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e3c5de56-cabb-47de-92c8-74d64062f101 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e3c5de56-cabb-47de-92c8-74d64062f101 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e3c5de56-cabb-47de-92c8-74d64062f101 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e3c5de56-cabb-47de-92c8-74d64062f101 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:34 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-e3c5de56-cabb-47de-92c8-74d64062f101 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299ba2e202244f59a09e22df9ea8efe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf93a24e754e1ea58c0a7fd4f553dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:15:34 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-e3c5de56-cabb-47de-92c8-74d64062f101 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c592508-0444-4b42-a0b5-e3d8bd97f5ba" status: 200 len: 1544 microversion: 2.1 time: 0.365673 Apr 18 16:15:34 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 36/108] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:15:33 2023] GET /compute/v2.1/servers/6c592508-0444-4b42-a0b5-e3d8bd97f5ba => generated 1544 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:15:47 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-fc318e12-cc56-4100-b455-0975bc1097d0 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:15:47 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-fc318e12-cc56-4100-b455-0975bc1097d0 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] [instance: b9feb20a-78c0-44ac-ab87-3a68a14396aa] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:15:47 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=12 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:47 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=7 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:47 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=7 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:47 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-fc318e12-cc56-4100-b455-0975bc1097d0 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:47 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-fc318e12-cc56-4100-b455-0975bc1097d0 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:47 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-fc318e12-cc56-4100-b455-0975bc1097d0 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:47 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-fc318e12-cc56-4100-b455-0975bc1097d0 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:47 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-fc318e12-cc56-4100-b455-0975bc1097d0 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:47 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-fc318e12-cc56-4100-b455-0975bc1097d0 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:48 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-fc318e12-cc56-4100-b455-0975bc1097d0 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] [instance: b9feb20a-78c0-44ac-ab87-3a68a14396aa] Going to try to terminate instance {{(pid=61296) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:15:48 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-fc318e12-cc56-4100-b455-0975bc1097d0 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b9feb20a-78c0-44ac-ab87-3a68a14396aa" status: 204 len: 0 microversion: 2.1 time: 0.169261 Apr 18 16:15:48 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 37/109] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:15:47 2023] DELETE /compute/v2.1/servers/b9feb20a-78c0-44ac-ab87-3a68a14396aa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:15:48 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-8195f4e4-30c2-4a2b-b273-14463f0fb111 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:15:48 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-8195f4e4-30c2-4a2b-b273-14463f0fb111 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] [instance: b9feb20a-78c0-44ac-ab87-3a68a14396aa] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:15:48 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=3 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:48 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=6 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8195f4e4-30c2-4a2b-b273-14463f0fb111 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8195f4e4-30c2-4a2b-b273-14463f0fb111 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8195f4e4-30c2-4a2b-b273-14463f0fb111 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8195f4e4-30c2-4a2b-b273-14463f0fb111 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8195f4e4-30c2-4a2b-b273-14463f0fb111 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8195f4e4-30c2-4a2b-b273-14463f0fb111 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:48 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-8195f4e4-30c2-4a2b-b273-14463f0fb111 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045e13d387f04d8eb0709154e4114bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb907be282bb4348976527807993ee58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:15:48 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-8195f4e4-30c2-4a2b-b273-14463f0fb111 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9feb20a-78c0-44ac-ab87-3a68a14396aa" status: 200 len: 1495 microversion: 2.1 time: 0.292662 Apr 18 16:15:48 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 37/110] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:15:48 2023] GET /compute/v2.1/servers/b9feb20a-78c0-44ac-ab87-3a68a14396aa => generated 1495 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:15:48 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-cde2cd84-2d59-4c89-847f-e152ff07ba5b req-957155fb-e4b3-446f-9084-1e50e217876c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9feb20a-78c0-44ac-ab87-3a68a14396aa", "name": "network-vif-unplugged", "status": "completed", "tag": "cba845fa-9bbc-4e86-9fc9-f9458343fcc9"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:15:48 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:48 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=6 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:15:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-cde2cd84-2d59-4c89-847f-e152ff07ba5b req-957155fb-e4b3-446f-9084-1e50e217876c service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-cde2cd84-2d59-4c89-847f-e152ff07ba5b req-957155fb-e4b3-446f-9084-1e50e217876c service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-cde2cd84-2d59-4c89-847f-e152ff07ba5b req-957155fb-e4b3-446f-9084-1e50e217876c service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:48 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-cde2cd84-2d59-4c89-847f-e152ff07ba5b req-957155fb-e4b3-446f-9084-1e50e217876c service nova] Creating event network-vif-unplugged:cba845fa-9bbc-4e86-9fc9-f9458343fcc9 for instance b9feb20a-78c0-44ac-ab87-3a68a14396aa on user Apr 18 16:15:48 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-cde2cd84-2d59-4c89-847f-e152ff07ba5b req-957155fb-e4b3-446f-9084-1e50e217876c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030550 Apr 18 16:15:48 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 37/111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:15:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:15:49 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-266eddf6-cf50-4671-a8c4-47d488ad8b97 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:15:49 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-266eddf6-cf50-4671-a8c4-47d488ad8b97 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:15:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-266eddf6-cf50-4671-a8c4-47d488ad8b97 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-266eddf6-cf50-4671-a8c4-47d488ad8b97 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-266eddf6-cf50-4671-a8c4-47d488ad8b97 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-266eddf6-cf50-4671-a8c4-47d488ad8b97 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-266eddf6-cf50-4671-a8c4-47d488ad8b97 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-266eddf6-cf50-4671-a8c4-47d488ad8b97 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:49 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-266eddf6-cf50-4671-a8c4-47d488ad8b97 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd46686fd5b845cca0f3d9452a86f4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82a93c1cb9b4a4da7114874ddf0aa27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:15:49 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-266eddf6-cf50-4671-a8c4-47d488ad8b97 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c" status: 200 len: 1538 microversion: 2.1 time: 0.431997 Apr 18 16:15:49 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 38/112] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:15:49 2023] GET /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c => generated 1538 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:15:49 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-18a6ad5e-0eeb-4efc-8d33-c8d846d4a110 req-1acffa70-db51-4b22-bb1b-26de858f750e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9feb20a-78c0-44ac-ab87-3a68a14396aa", "name": "network-vif-deleted", "tag": "cba845fa-9bbc-4e86-9fc9-f9458343fcc9"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:15:49 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-18a6ad5e-0eeb-4efc-8d33-c8d846d4a110 req-1acffa70-db51-4b22-bb1b-26de858f750e service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:49 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-18a6ad5e-0eeb-4efc-8d33-c8d846d4a110 req-1acffa70-db51-4b22-bb1b-26de858f750e service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:49 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-18a6ad5e-0eeb-4efc-8d33-c8d846d4a110 req-1acffa70-db51-4b22-bb1b-26de858f750e service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:49 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-18a6ad5e-0eeb-4efc-8d33-c8d846d4a110 req-1acffa70-db51-4b22-bb1b-26de858f750e service nova] Creating event network-vif-deleted:cba845fa-9bbc-4e86-9fc9-f9458343fcc9 for instance b9feb20a-78c0-44ac-ab87-3a68a14396aa on user Apr 18 16:15:49 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-18a6ad5e-0eeb-4efc-8d33-c8d846d4a110 req-1acffa70-db51-4b22-bb1b-26de858f750e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027232 Apr 18 16:15:49 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 38/113] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:15:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:15:50 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-c6cbcd95-9822-4c05-ab00-2b90cdb9395f req-f91bb59c-d1b3-4042-9a00-4fa1192937eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9feb20a-78c0-44ac-ab87-3a68a14396aa", "name": "network-vif-plugged", "status": "completed", "tag": "cba845fa-9bbc-4e86-9fc9-f9458343fcc9"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:15:50 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-c6cbcd95-9822-4c05-ab00-2b90cdb9395f req-f91bb59c-d1b3-4042-9a00-4fa1192937eb service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:50 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-c6cbcd95-9822-4c05-ab00-2b90cdb9395f req-f91bb59c-d1b3-4042-9a00-4fa1192937eb service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:50 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-c6cbcd95-9822-4c05-ab00-2b90cdb9395f req-f91bb59c-d1b3-4042-9a00-4fa1192937eb service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:50 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-c6cbcd95-9822-4c05-ab00-2b90cdb9395f req-f91bb59c-d1b3-4042-9a00-4fa1192937eb service nova] Creating event network-vif-plugged:cba845fa-9bbc-4e86-9fc9-f9458343fcc9 for instance b9feb20a-78c0-44ac-ab87-3a68a14396aa on user Apr 18 16:15:50 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-c6cbcd95-9822-4c05-ab00-2b90cdb9395f req-f91bb59c-d1b3-4042-9a00-4fa1192937eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029179 Apr 18 16:15:50 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 38/114] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:15:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:15:54 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-80cbb81f-193e-4734-b748-79bd4cdaf6a0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:15:54 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-80cbb81f-193e-4734-b748-79bd4cdaf6a0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] [instance: 8aaa4e97-9439-4760-9e05-8b248b02074f] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:15:54 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-80cbb81f-193e-4734-b748-79bd4cdaf6a0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:54 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-80cbb81f-193e-4734-b748-79bd4cdaf6a0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:54 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-80cbb81f-193e-4734-b748-79bd4cdaf6a0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:54 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-80cbb81f-193e-4734-b748-79bd4cdaf6a0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:54 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-80cbb81f-193e-4734-b748-79bd4cdaf6a0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:54 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-80cbb81f-193e-4734-b748-79bd4cdaf6a0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:55 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-80cbb81f-193e-4734-b748-79bd4cdaf6a0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a284b1ad50e463894f8d58d38a57d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fc24a9e1b646a2a08df4f53f712267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:15:55 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-80cbb81f-193e-4734-b748-79bd4cdaf6a0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f" status: 200 len: 1553 microversion: 2.1 time: 0.209760 Apr 18 16:15:55 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 39/115] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:15:54 2023] GET /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:15:57 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-d753bd39-ff22-4766-a8a6-05aea3d9490f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:15:57 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-d753bd39-ff22-4766-a8a6-05aea3d9490f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:15:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-d753bd39-ff22-4766-a8a6-05aea3d9490f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-d753bd39-ff22-4766-a8a6-05aea3d9490f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-d753bd39-ff22-4766-a8a6-05aea3d9490f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-d753bd39-ff22-4766-a8a6-05aea3d9490f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-d753bd39-ff22-4766-a8a6-05aea3d9490f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-d753bd39-ff22-4766-a8a6-05aea3d9490f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:58 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-d753bd39-ff22-4766-a8a6-05aea3d9490f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.189572 Apr 18 16:15:58 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 39/116] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 16:15:57 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175/os-interface => generated 283 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:15:59 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-98bc4293-9f8e-439e-af83-af9edf777672 req-479e8751-b80c-4212-ad12-29bc94be7a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b530349-680e-4def-86ef-29c340efa175", "tag": "64d26c20-add4-4a63-bace-6a3678032692"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:15:59 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-98bc4293-9f8e-439e-af83-af9edf777672 req-479e8751-b80c-4212-ad12-29bc94be7a38 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:59 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-98bc4293-9f8e-439e-af83-af9edf777672 req-479e8751-b80c-4212-ad12-29bc94be7a38 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:59 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-98bc4293-9f8e-439e-af83-af9edf777672 req-479e8751-b80c-4212-ad12-29bc94be7a38 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:59 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-98bc4293-9f8e-439e-af83-af9edf777672 req-479e8751-b80c-4212-ad12-29bc94be7a38 service nova] Creating event network-changed:64d26c20-add4-4a63-bace-6a3678032692 for instance 1b530349-680e-4def-86ef-29c340efa175 on user Apr 18 16:15:59 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-98bc4293-9f8e-439e-af83-af9edf777672 req-479e8751-b80c-4212-ad12-29bc94be7a38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030728 Apr 18 16:15:59 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 39/117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:15:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:15:59 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-88cdb640-913a-458b-b81d-e2731ee26225 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:15:59 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-88cdb640-913a-458b-b81d-e2731ee26225 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:15:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-88cdb640-913a-458b-b81d-e2731ee26225 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-88cdb640-913a-458b-b81d-e2731ee26225 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-88cdb640-913a-458b-b81d-e2731ee26225 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-88cdb640-913a-458b-b81d-e2731ee26225 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-88cdb640-913a-458b-b81d-e2731ee26225 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-88cdb640-913a-458b-b81d-e2731ee26225 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:59 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-88cdb640-913a-458b-b81d-e2731ee26225 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b7b9d8fdcf42f29e83e755f4f27380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa61b19cc4e4cd4bb7d41291c40ef1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:15:59 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-88cdb640-913a-458b-b81d-e2731ee26225 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 200 len: 1539 microversion: 2.1 time: 0.595169 Apr 18 16:15:59 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 40/118] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:15:59 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 1539 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:15:59 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-a62cdb85-11b5-4ae5-aec1-312e253f080c tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:15:59 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-a62cdb85-11b5-4ae5-aec1-312e253f080c tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:15:59 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a62cdb85-11b5-4ae5-aec1-312e253f080c tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:59 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a62cdb85-11b5-4ae5-aec1-312e253f080c tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:59 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a62cdb85-11b5-4ae5-aec1-312e253f080c tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:59 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a62cdb85-11b5-4ae5-aec1-312e253f080c tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:15:59 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a62cdb85-11b5-4ae5-aec1-312e253f080c tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:15:59 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a62cdb85-11b5-4ae5-aec1-312e253f080c tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:15:59 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-a62cdb85-11b5-4ae5-aec1-312e253f080c tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b7b9d8fdcf42f29e83e755f4f27380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa61b19cc4e4cd4bb7d41291c40ef1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:15:59 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-a62cdb85-11b5-4ae5-aec1-312e253f080c tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 200 len: 1539 microversion: 2.1 time: 0.134883 Apr 18 16:15:59 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 40/119] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:15:59 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 1539 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:16:00 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-38b8facd-cf6d-492a-b045-6d36bd9abf1b tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:00 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-38b8facd-cf6d-492a-b045-6d36bd9abf1b tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: d7a293bf-a9bd-424e-ba11-bbed7dfea41c] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-38b8facd-cf6d-492a-b045-6d36bd9abf1b tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-38b8facd-cf6d-492a-b045-6d36bd9abf1b tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-38b8facd-cf6d-492a-b045-6d36bd9abf1b tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-38b8facd-cf6d-492a-b045-6d36bd9abf1b tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-38b8facd-cf6d-492a-b045-6d36bd9abf1b tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-38b8facd-cf6d-492a-b045-6d36bd9abf1b tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:00 user devstack@n-api.service[61295]: DEBUG nova.objects.instance [None req-38b8facd-cf6d-492a-b045-6d36bd9abf1b tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lazy-loading 'flavor' on Instance uuid d7a293bf-a9bd-424e-ba11-bbed7dfea41c {{(pid=61295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 16:16:01 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-38b8facd-cf6d-492a-b045-6d36bd9abf1b tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c/action" status: 200 len: 32 microversion: 2.1 time: 0.199467 Apr 18 16:16:01 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 40/120] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 18 16:16:00 2023] POST /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 18 16:16:01 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-f070219f-95eb-4dc2-88fe-647379dae3c1 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:01 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-f070219f-95eb-4dc2-88fe-647379dae3c1 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: d7a293bf-a9bd-424e-ba11-bbed7dfea41c] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:01 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f070219f-95eb-4dc2-88fe-647379dae3c1 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:01 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f070219f-95eb-4dc2-88fe-647379dae3c1 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:01 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f070219f-95eb-4dc2-88fe-647379dae3c1 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:01 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f070219f-95eb-4dc2-88fe-647379dae3c1 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:01 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f070219f-95eb-4dc2-88fe-647379dae3c1 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:01 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f070219f-95eb-4dc2-88fe-647379dae3c1 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:01 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-f070219f-95eb-4dc2-88fe-647379dae3c1 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3f45f9c6c431781fb582b8da22b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261e8ba82d9e4203917afb0241a3b4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:16:01 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-f070219f-95eb-4dc2-88fe-647379dae3c1 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c" status: 200 len: 1511 microversion: 2.1 time: 0.320101 Apr 18 16:16:01 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 41/121] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:16:01 2023] GET /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c => generated 1511 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:16:01 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-9792d29c-5bb5-406d-89e4-3a6799272601 req-c1d50670-d22d-460c-af0e-b1880e017437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a293bf-a9bd-424e-ba11-bbed7dfea41c", "name": "network-vif-unplugged", "status": "completed", "tag": "e5d69d5c-1a5c-4300-ab15-e73f78388f0e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:01 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-9792d29c-5bb5-406d-89e4-3a6799272601 req-c1d50670-d22d-460c-af0e-b1880e017437 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:01 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-9792d29c-5bb5-406d-89e4-3a6799272601 req-c1d50670-d22d-460c-af0e-b1880e017437 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:01 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-9792d29c-5bb5-406d-89e4-3a6799272601 req-c1d50670-d22d-460c-af0e-b1880e017437 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:01 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-9792d29c-5bb5-406d-89e4-3a6799272601 req-c1d50670-d22d-460c-af0e-b1880e017437 service nova] Creating event network-vif-unplugged:e5d69d5c-1a5c-4300-ab15-e73f78388f0e for instance d7a293bf-a9bd-424e-ba11-bbed7dfea41c on user Apr 18 16:16:01 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-9792d29c-5bb5-406d-89e4-3a6799272601 req-c1d50670-d22d-460c-af0e-b1880e017437 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032073 Apr 18 16:16:01 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 41/122] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:03 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-a17dfb30-40ea-4dba-96a7-c9a25ce9601a req-4422a4a9-0dff-40e2-9bad-23f2add07de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a293bf-a9bd-424e-ba11-bbed7dfea41c", "name": "network-vif-plugged", "status": "completed", "tag": "e5d69d5c-1a5c-4300-ab15-e73f78388f0e"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:04 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-a17dfb30-40ea-4dba-96a7-c9a25ce9601a req-4422a4a9-0dff-40e2-9bad-23f2add07de5 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:04 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-a17dfb30-40ea-4dba-96a7-c9a25ce9601a req-4422a4a9-0dff-40e2-9bad-23f2add07de5 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:04 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-a17dfb30-40ea-4dba-96a7-c9a25ce9601a req-4422a4a9-0dff-40e2-9bad-23f2add07de5 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:04 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-a17dfb30-40ea-4dba-96a7-c9a25ce9601a req-4422a4a9-0dff-40e2-9bad-23f2add07de5 service nova] Creating event network-vif-plugged:e5d69d5c-1a5c-4300-ab15-e73f78388f0e for instance d7a293bf-a9bd-424e-ba11-bbed7dfea41c on user Apr 18 16:16:04 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-a17dfb30-40ea-4dba-96a7-c9a25ce9601a req-4422a4a9-0dff-40e2-9bad-23f2add07de5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240810 Apr 18 16:16:04 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 41/123] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:06 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-2ef51212-ea4d-4f04-b95f-29b8f87a4aaf req-87e82064-9267-405f-977b-ac553167a6ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a293bf-a9bd-424e-ba11-bbed7dfea41c", "name": "network-vif-plugged", "status": "completed", "tag": "e5d69d5c-1a5c-4300-ab15-e73f78388f0e"}, {"server_uuid": "d7a293bf-a9bd-424e-ba11-bbed7dfea41c", "name": "network-vif-plugged", "status": "completed", "tag": "e5d69d5c-1a5c-4300-ab15-e73f78388f0e"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:06 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-2ef51212-ea4d-4f04-b95f-29b8f87a4aaf req-87e82064-9267-405f-977b-ac553167a6ca service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:06 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-2ef51212-ea4d-4f04-b95f-29b8f87a4aaf req-87e82064-9267-405f-977b-ac553167a6ca service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:06 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-2ef51212-ea4d-4f04-b95f-29b8f87a4aaf req-87e82064-9267-405f-977b-ac553167a6ca service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:06 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-2ef51212-ea4d-4f04-b95f-29b8f87a4aaf req-87e82064-9267-405f-977b-ac553167a6ca service nova] Creating event network-vif-plugged:e5d69d5c-1a5c-4300-ab15-e73f78388f0e for instance d7a293bf-a9bd-424e-ba11-bbed7dfea41c on user Apr 18 16:16:06 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-2ef51212-ea4d-4f04-b95f-29b8f87a4aaf req-87e82064-9267-405f-977b-ac553167a6ca service nova] Creating event network-vif-plugged:e5d69d5c-1a5c-4300-ab15-e73f78388f0e for instance d7a293bf-a9bd-424e-ba11-bbed7dfea41c on user Apr 18 16:16:06 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-2ef51212-ea4d-4f04-b95f-29b8f87a4aaf req-87e82064-9267-405f-977b-ac553167a6ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030668 Apr 18 16:16:06 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 42/124] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:12 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=10 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:16:12 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=20 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:16:12 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-137e8584-6254-4006-b24e-88104c8b612a tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:12 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-137e8584-6254-4006-b24e-88104c8b612a tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: 993d062c-8462-4534-bcde-9249779d4e90] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:12 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-137e8584-6254-4006-b24e-88104c8b612a tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:12 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-137e8584-6254-4006-b24e-88104c8b612a tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:12 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-137e8584-6254-4006-b24e-88104c8b612a tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:12 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-137e8584-6254-4006-b24e-88104c8b612a tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:12 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-137e8584-6254-4006-b24e-88104c8b612a tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:12 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-137e8584-6254-4006-b24e-88104c8b612a tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:12 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-137e8584-6254-4006-b24e-88104c8b612a tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.169875 Apr 18 16:16:12 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 42/125] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 16:16:12 2023] GET /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90/os-interface => generated 282 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:14 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=10 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:16:14 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:16:14 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-b32e032e-096b-41dd-b8ec-586b105fbb19 req-ded49725-43e8-4029-816b-42bd916c823c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993d062c-8462-4534-bcde-9249779d4e90", "tag": "fe3d4b7c-e19e-4931-8ac7-baad36fbf1b3"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:14 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-b32e032e-096b-41dd-b8ec-586b105fbb19 req-ded49725-43e8-4029-816b-42bd916c823c service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:14 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-b32e032e-096b-41dd-b8ec-586b105fbb19 req-ded49725-43e8-4029-816b-42bd916c823c service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:14 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-b32e032e-096b-41dd-b8ec-586b105fbb19 req-ded49725-43e8-4029-816b-42bd916c823c service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:14 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-b32e032e-096b-41dd-b8ec-586b105fbb19 req-ded49725-43e8-4029-816b-42bd916c823c service nova] Creating event network-changed:fe3d4b7c-e19e-4931-8ac7-baad36fbf1b3 for instance 993d062c-8462-4534-bcde-9249779d4e90 on user Apr 18 16:16:14 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-b32e032e-096b-41dd-b8ec-586b105fbb19 req-ded49725-43e8-4029-816b-42bd916c823c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044184 Apr 18 16:16:14 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 42/126] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:14 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-528a71c5-399e-4cd5-9fda-bd53eaa57065 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:14 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-528a71c5-399e-4cd5-9fda-bd53eaa57065 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: 993d062c-8462-4534-bcde-9249779d4e90] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:14 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-528a71c5-399e-4cd5-9fda-bd53eaa57065 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:14 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-528a71c5-399e-4cd5-9fda-bd53eaa57065 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:14 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-528a71c5-399e-4cd5-9fda-bd53eaa57065 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:14 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-528a71c5-399e-4cd5-9fda-bd53eaa57065 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:14 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-528a71c5-399e-4cd5-9fda-bd53eaa57065 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:14 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-528a71c5-399e-4cd5-9fda-bd53eaa57065 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:14 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-528a71c5-399e-4cd5-9fda-bd53eaa57065 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90/ips" status: 200 len: 108 microversion: 2.1 time: 0.045202 Apr 18 16:16:14 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 43/127] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 16:16:14 2023] GET /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90/ips => generated 108 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:15 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-8b90e197-0f0e-4b95-b9d7-b1d316aa1db1 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:15 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-8b90e197-0f0e-4b95-b9d7-b1d316aa1db1 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: 993d062c-8462-4534-bcde-9249779d4e90] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:15 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8b90e197-0f0e-4b95-b9d7-b1d316aa1db1 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:15 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8b90e197-0f0e-4b95-b9d7-b1d316aa1db1 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:15 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8b90e197-0f0e-4b95-b9d7-b1d316aa1db1 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:15 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8b90e197-0f0e-4b95-b9d7-b1d316aa1db1 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:15 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8b90e197-0f0e-4b95-b9d7-b1d316aa1db1 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:15 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8b90e197-0f0e-4b95-b9d7-b1d316aa1db1 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:15 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-8b90e197-0f0e-4b95-b9d7-b1d316aa1db1 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: 993d062c-8462-4534-bcde-9249779d4e90] Going to try to terminate instance {{(pid=61294) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:16:16 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-8b90e197-0f0e-4b95-b9d7-b1d316aa1db1 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90" status: 204 len: 0 microversion: 2.1 time: 0.416511 Apr 18 16:16:16 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 43/128] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:16:15 2023] DELETE /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:16:16 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-ace3cfe1-d024-4665-9f53-5398b9079fc8 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:16 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-ace3cfe1-d024-4665-9f53-5398b9079fc8 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: 993d062c-8462-4534-bcde-9249779d4e90] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ace3cfe1-d024-4665-9f53-5398b9079fc8 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ace3cfe1-d024-4665-9f53-5398b9079fc8 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ace3cfe1-d024-4665-9f53-5398b9079fc8 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ace3cfe1-d024-4665-9f53-5398b9079fc8 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ace3cfe1-d024-4665-9f53-5398b9079fc8 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:16 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ace3cfe1-d024-4665-9f53-5398b9079fc8 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:16 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-e3fdc046-5214-455a-bea0-6e7413ee4fae req-e7b06ff2-5316-4fdf-8343-9e9d41b5053d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993d062c-8462-4534-bcde-9249779d4e90", "name": "network-vif-unplugged", "status": "completed", "tag": "fe3d4b7c-e19e-4931-8ac7-baad36fbf1b3"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:16 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-e3fdc046-5214-455a-bea0-6e7413ee4fae req-e7b06ff2-5316-4fdf-8343-9e9d41b5053d service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:16 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-e3fdc046-5214-455a-bea0-6e7413ee4fae req-e7b06ff2-5316-4fdf-8343-9e9d41b5053d service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:16 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-e3fdc046-5214-455a-bea0-6e7413ee4fae req-e7b06ff2-5316-4fdf-8343-9e9d41b5053d service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:16 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-e3fdc046-5214-455a-bea0-6e7413ee4fae req-e7b06ff2-5316-4fdf-8343-9e9d41b5053d service nova] Creating event network-vif-unplugged:fe3d4b7c-e19e-4931-8ac7-baad36fbf1b3 for instance 993d062c-8462-4534-bcde-9249779d4e90 on user Apr 18 16:16:16 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-e3fdc046-5214-455a-bea0-6e7413ee4fae req-e7b06ff2-5316-4fdf-8343-9e9d41b5053d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030260 Apr 18 16:16:16 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 44/129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:16 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-ace3cfe1-d024-4665-9f53-5398b9079fc8 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af90e17ec027463fa8793e8539c39e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4e8d8797be4c0e91b1401538f2eba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:16:16 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-ace3cfe1-d024-4665-9f53-5398b9079fc8 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90" status: 200 len: 1667 microversion: 2.1 time: 0.404402 Apr 18 16:16:16 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 43/130] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:16:16 2023] GET /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90 => generated 1667 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:16:17 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-c039f7ec-32cd-4629-839a-8d1707f16da7 req-2856feb1-1bcb-4514-879f-62c0223a205d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993d062c-8462-4534-bcde-9249779d4e90", "name": "network-vif-deleted", "tag": "fe3d4b7c-e19e-4931-8ac7-baad36fbf1b3"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:17 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-c039f7ec-32cd-4629-839a-8d1707f16da7 req-2856feb1-1bcb-4514-879f-62c0223a205d service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:17 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-c039f7ec-32cd-4629-839a-8d1707f16da7 req-2856feb1-1bcb-4514-879f-62c0223a205d service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:17 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-c039f7ec-32cd-4629-839a-8d1707f16da7 req-2856feb1-1bcb-4514-879f-62c0223a205d service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:17 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-c039f7ec-32cd-4629-839a-8d1707f16da7 req-2856feb1-1bcb-4514-879f-62c0223a205d service nova] Creating event network-vif-deleted:fe3d4b7c-e19e-4931-8ac7-baad36fbf1b3 for instance 993d062c-8462-4534-bcde-9249779d4e90 on user Apr 18 16:16:17 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-c039f7ec-32cd-4629-839a-8d1707f16da7 req-2856feb1-1bcb-4514-879f-62c0223a205d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027637 Apr 18 16:16:17 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 44/131] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:18 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-43868197-87ae-4a70-a724-1595b3243ca1 req-fcac0d06-ce96-4cb3-ab59-575ff366190b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993d062c-8462-4534-bcde-9249779d4e90", "name": "network-vif-plugged", "status": "completed", "tag": "fe3d4b7c-e19e-4931-8ac7-baad36fbf1b3"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:18 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:16:18 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-43868197-87ae-4a70-a724-1595b3243ca1 req-fcac0d06-ce96-4cb3-ab59-575ff366190b service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:18 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-43868197-87ae-4a70-a724-1595b3243ca1 req-fcac0d06-ce96-4cb3-ab59-575ff366190b service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:18 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-43868197-87ae-4a70-a724-1595b3243ca1 req-fcac0d06-ce96-4cb3-ab59-575ff366190b service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:18 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:16:18 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-43868197-87ae-4a70-a724-1595b3243ca1 req-fcac0d06-ce96-4cb3-ab59-575ff366190b service nova] Creating event network-vif-plugged:fe3d4b7c-e19e-4931-8ac7-baad36fbf1b3 for instance 993d062c-8462-4534-bcde-9249779d4e90 on user Apr 18 16:16:18 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-43868197-87ae-4a70-a724-1595b3243ca1 req-fcac0d06-ce96-4cb3-ab59-575ff366190b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034800 Apr 18 16:16:18 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 45/132] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:26 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-12769dae-5564-41b7-9479-6165e3d3cce0 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:26 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-12769dae-5564-41b7-9479-6165e3d3cce0 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] [instance: aaac3797-349f-4695-bea2-8b0c022a66e0] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:26 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-12769dae-5564-41b7-9479-6165e3d3cce0 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:26 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-12769dae-5564-41b7-9479-6165e3d3cce0 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:26 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-12769dae-5564-41b7-9479-6165e3d3cce0 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:26 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-12769dae-5564-41b7-9479-6165e3d3cce0 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:26 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-12769dae-5564-41b7-9479-6165e3d3cce0 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:26 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-12769dae-5564-41b7-9479-6165e3d3cce0 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:26 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-12769dae-5564-41b7-9479-6165e3d3cce0 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.194372 Apr 18 16:16:26 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 44/133] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 16:16:26 2023] GET /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0/os-interface => generated 282 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:27 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-f1c8f9cf-5018-4c99-b64f-8cda2dc39553 req-86f01186-7c3c-4af1-8581-8a876eca63e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaac3797-349f-4695-bea2-8b0c022a66e0", "tag": "f2d5008c-284e-45a5-b349-4fe0723e138e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:27 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-f1c8f9cf-5018-4c99-b64f-8cda2dc39553 req-86f01186-7c3c-4af1-8581-8a876eca63e4 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:27 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-f1c8f9cf-5018-4c99-b64f-8cda2dc39553 req-86f01186-7c3c-4af1-8581-8a876eca63e4 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:27 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-f1c8f9cf-5018-4c99-b64f-8cda2dc39553 req-86f01186-7c3c-4af1-8581-8a876eca63e4 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:27 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-f1c8f9cf-5018-4c99-b64f-8cda2dc39553 req-86f01186-7c3c-4af1-8581-8a876eca63e4 service nova] Creating event network-changed:f2d5008c-284e-45a5-b349-4fe0723e138e for instance aaac3797-349f-4695-bea2-8b0c022a66e0 on user Apr 18 16:16:27 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-f1c8f9cf-5018-4c99-b64f-8cda2dc39553 req-86f01186-7c3c-4af1-8581-8a876eca63e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032269 Apr 18 16:16:27 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 45/134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:29 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:16:29 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-a0244e35-2c8c-4fae-a039-7a7095d5cd9e tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:29 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-a0244e35-2c8c-4fae-a039-7a7095d5cd9e tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] [instance: aaac3797-349f-4695-bea2-8b0c022a66e0] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a0244e35-2c8c-4fae-a039-7a7095d5cd9e tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a0244e35-2c8c-4fae-a039-7a7095d5cd9e tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a0244e35-2c8c-4fae-a039-7a7095d5cd9e tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a0244e35-2c8c-4fae-a039-7a7095d5cd9e tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a0244e35-2c8c-4fae-a039-7a7095d5cd9e tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a0244e35-2c8c-4fae-a039-7a7095d5cd9e tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:29 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-a0244e35-2c8c-4fae-a039-7a7095d5cd9e tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] [instance: aaac3797-349f-4695-bea2-8b0c022a66e0] Going to try to terminate instance {{(pid=61296) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:16:29 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-a0244e35-2c8c-4fae-a039-7a7095d5cd9e tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0" status: 204 len: 0 microversion: 2.1 time: 0.110247 Apr 18 16:16:29 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 46/135] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:16:29 2023] DELETE /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:16:29 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-ac18c6dc-3395-4cf3-b909-b3c39dfe3328 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:29 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-ac18c6dc-3395-4cf3-b909-b3c39dfe3328 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] [instance: aaac3797-349f-4695-bea2-8b0c022a66e0] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:29 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ac18c6dc-3395-4cf3-b909-b3c39dfe3328 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:29 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ac18c6dc-3395-4cf3-b909-b3c39dfe3328 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:29 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ac18c6dc-3395-4cf3-b909-b3c39dfe3328 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:29 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ac18c6dc-3395-4cf3-b909-b3c39dfe3328 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:29 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ac18c6dc-3395-4cf3-b909-b3c39dfe3328 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:29 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ac18c6dc-3395-4cf3-b909-b3c39dfe3328 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:29 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-ac18c6dc-3395-4cf3-b909-b3c39dfe3328 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffaa9df682cb40739d1d754000e04743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b357cc820a04f3486f98d8e38c1a3d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:16:29 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-ac18c6dc-3395-4cf3-b909-b3c39dfe3328 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0" status: 200 len: 1672 microversion: 2.1 time: 0.193855 Apr 18 16:16:29 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 45/136] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:16:29 2023] GET /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0 => generated 1672 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:16:29 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-c926647e-5217-4b5b-9b17-fa331241780e req-5951b17a-98ed-4a16-a057-da6d05c9e7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaac3797-349f-4695-bea2-8b0c022a66e0", "name": "network-vif-unplugged", "status": "completed", "tag": "f2d5008c-284e-45a5-b349-4fe0723e138e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-c926647e-5217-4b5b-9b17-fa331241780e req-5951b17a-98ed-4a16-a057-da6d05c9e7a8 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-c926647e-5217-4b5b-9b17-fa331241780e req-5951b17a-98ed-4a16-a057-da6d05c9e7a8 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-c926647e-5217-4b5b-9b17-fa331241780e req-5951b17a-98ed-4a16-a057-da6d05c9e7a8 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:29 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-c926647e-5217-4b5b-9b17-fa331241780e req-5951b17a-98ed-4a16-a057-da6d05c9e7a8 service nova] Creating event network-vif-unplugged:f2d5008c-284e-45a5-b349-4fe0723e138e for instance aaac3797-349f-4695-bea2-8b0c022a66e0 on user Apr 18 16:16:29 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-c926647e-5217-4b5b-9b17-fa331241780e req-5951b17a-98ed-4a16-a057-da6d05c9e7a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033406 Apr 18 16:16:29 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 46/137] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:31 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-1c14db23-d5d1-45ef-8bf5-3111f0e3eeb9 req-3b2866d4-258a-49fc-bc53-da9c17345050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaac3797-349f-4695-bea2-8b0c022a66e0", "name": "network-vif-plugged", "status": "completed", "tag": "f2d5008c-284e-45a5-b349-4fe0723e138e"}, {"server_uuid": "aaac3797-349f-4695-bea2-8b0c022a66e0", "name": "network-vif-deleted", "tag": "f2d5008c-284e-45a5-b349-4fe0723e138e"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:31 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-1c14db23-d5d1-45ef-8bf5-3111f0e3eeb9 req-3b2866d4-258a-49fc-bc53-da9c17345050 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:31 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-1c14db23-d5d1-45ef-8bf5-3111f0e3eeb9 req-3b2866d4-258a-49fc-bc53-da9c17345050 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:31 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-1c14db23-d5d1-45ef-8bf5-3111f0e3eeb9 req-3b2866d4-258a-49fc-bc53-da9c17345050 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:31 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-1c14db23-d5d1-45ef-8bf5-3111f0e3eeb9 req-3b2866d4-258a-49fc-bc53-da9c17345050 service nova] Creating event network-vif-plugged:f2d5008c-284e-45a5-b349-4fe0723e138e for instance aaac3797-349f-4695-bea2-8b0c022a66e0 on user Apr 18 16:16:31 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-1c14db23-d5d1-45ef-8bf5-3111f0e3eeb9 req-3b2866d4-258a-49fc-bc53-da9c17345050 service nova] Creating event network-vif-deleted:f2d5008c-284e-45a5-b349-4fe0723e138e for instance aaac3797-349f-4695-bea2-8b0c022a66e0 on user Apr 18 16:16:31 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-1c14db23-d5d1-45ef-8bf5-3111f0e3eeb9 req-3b2866d4-258a-49fc-bc53-da9c17345050 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028599 Apr 18 16:16:31 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 47/138] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:34 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-85081e5e-e059-4c14-b099-d3fc784abeaf tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:34 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-85081e5e-e059-4c14-b099-d3fc784abeaf tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] [instance: 6c592508-0444-4b42-a0b5-e3d8bd97f5ba] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:34 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-85081e5e-e059-4c14-b099-d3fc784abeaf tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:34 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-85081e5e-e059-4c14-b099-d3fc784abeaf tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:34 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-85081e5e-e059-4c14-b099-d3fc784abeaf tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:34 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-85081e5e-e059-4c14-b099-d3fc784abeaf tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:34 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-85081e5e-e059-4c14-b099-d3fc784abeaf tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:34 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-85081e5e-e059-4c14-b099-d3fc784abeaf tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:34 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-85081e5e-e059-4c14-b099-d3fc784abeaf tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c592508-0444-4b42-a0b5-e3d8bd97f5ba/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.233039 Apr 18 16:16:34 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 46/139] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 16:16:34 2023] GET /compute/v2.1/servers/6c592508-0444-4b42-a0b5-e3d8bd97f5ba/os-interface => generated 283 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:35 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-9bd79f78-5aa9-4f24-9ce3-778c3db452c3 req-76c3b475-8a9a-4551-ae93-7a118d6547e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c592508-0444-4b42-a0b5-e3d8bd97f5ba", "tag": "395afd81-e898-47ee-a928-eaab584d5b4e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:35 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-9bd79f78-5aa9-4f24-9ce3-778c3db452c3 req-76c3b475-8a9a-4551-ae93-7a118d6547e8 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:35 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-9bd79f78-5aa9-4f24-9ce3-778c3db452c3 req-76c3b475-8a9a-4551-ae93-7a118d6547e8 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:35 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-9bd79f78-5aa9-4f24-9ce3-778c3db452c3 req-76c3b475-8a9a-4551-ae93-7a118d6547e8 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:35 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-9bd79f78-5aa9-4f24-9ce3-778c3db452c3 req-76c3b475-8a9a-4551-ae93-7a118d6547e8 service nova] Creating event network-changed:395afd81-e898-47ee-a928-eaab584d5b4e for instance 6c592508-0444-4b42-a0b5-e3d8bd97f5ba on user Apr 18 16:16:35 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-9bd79f78-5aa9-4f24-9ce3-778c3db452c3 req-76c3b475-8a9a-4551-ae93-7a118d6547e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029104 Apr 18 16:16:35 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 47/140] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:36 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-995654785", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "networks": [{"uuid": "0fafa4bf-5d8d-43f9-8cc3-ae6e7c58812c"}]}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:36 user devstack@n-api.service[61296]: DEBUG nova.network.neutron [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] validate_networks() for [('0fafa4bf-5d8d-43f9-8cc3-ae6e7c58812c', None, None, None, None, None)] {{(pid=61296) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:16:37 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Flavor limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:16:37 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Image limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:16:37 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Flavor pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:16:37 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Image pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:16:37 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:16:37 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:37 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:37 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:37 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:37 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:37 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:37 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Getting quotas for project 8edf93a24e754e1ea58c0a7fd4f553dc. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:16:37 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Getting quotas for user 299ba2e202244f59a09e22df9ea8efe7 and project 8edf93a24e754e1ea58c0a7fd4f553dc. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:16:37 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Going to run 1 instances... {{(pid=61296) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:16:37 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] [instance: 0ad9c135-f279-4bd8-982d-65b45242adcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:16:37 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-c6686c47-1616-4faf-b902-65a26c4ec2ed tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.616767 Apr 18 16:16:37 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 48/141] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:16:36 2023] POST /compute/v2.1/servers => generated 378 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:16:37 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-2a096743-1222-4395-8fa6-238ee63c0da7 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:37 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-2a096743-1222-4395-8fa6-238ee63c0da7 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] [instance: 0ad9c135-f279-4bd8-982d-65b45242adcf] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:37 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-2a096743-1222-4395-8fa6-238ee63c0da7 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299ba2e202244f59a09e22df9ea8efe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf93a24e754e1ea58c0a7fd4f553dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:16:37 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-2a096743-1222-4395-8fa6-238ee63c0da7 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ad9c135-f279-4bd8-982d-65b45242adcf" status: 200 len: 1211 microversion: 2.1 time: 0.083088 Apr 18 16:16:37 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 47/142] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:16:37 2023] GET /compute/v2.1/servers/0ad9c135-f279-4bd8-982d-65b45242adcf => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:16:38 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-12106415-c1f7-4489-8228-fe93aecb0e65 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:38 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-12106415-c1f7-4489-8228-fe93aecb0e65 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] [instance: b9feb20a-78c0-44ac-ab87-3a68a14396aa] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-12106415-c1f7-4489-8228-fe93aecb0e65 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-12106415-c1f7-4489-8228-fe93aecb0e65 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-12106415-c1f7-4489-8228-fe93aecb0e65 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-12106415-c1f7-4489-8228-fe93aecb0e65 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-12106415-c1f7-4489-8228-fe93aecb0e65 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-12106415-c1f7-4489-8228-fe93aecb0e65 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:38 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-12106415-c1f7-4489-8228-fe93aecb0e65 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] HTTP exception thrown: Instance b9feb20a-78c0-44ac-ab87-3a68a14396aa could not be found. Apr 18 16:16:38 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-12106415-c1f7-4489-8228-fe93aecb0e65 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Request method failure captured: Apr 18 16:16:38 user devstack@n-api.service[61294]: request: GET /compute/v2.1/servers/b9feb20a-78c0-44ac-ab87-3a68a14396aa HTTP/1.1 Apr 18 16:16:38 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:16:38 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:16:38 user devstack@n-api.service[61294]: Connection: close Apr 18 16:16:38 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:16:38 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:16:38 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:16:38 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:16:38 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:16:38 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsHBEg1dOAvFCp4ELsa9lpTS5Y3nGDMyLJWfCJ-LIs4VXgWCHeTMKezpKhQD--hUIzxIHEiIj_F1GOdJJI4uOqpo_W2uEqD1bu7qxmYqBgXZ9-F-pnFad9tyy_qdsNTvpioR6hYjXBM-QS5jc5WrAU9zefvYZoiqv4qvFEPYj7SvQ9E Apr 18 16:16:38 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:16:38 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:16:38 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:16:38 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:16:38 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:16:38 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:16:38 user devstack@n-api.service[61294]: X-Project-Id: eb907be282bb4348976527807993ee58 Apr 18 16:16:38 user devstack@n-api.service[61294]: X-Project-Name: tempest-DeleteServersTestJSON-1528617807 Apr 18 16:16:38 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:16:38 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:16:38 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb907be282bb4348976527807993ee58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb907be282bb4348976527807993ee58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb907be282bb4348976527807993ee58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:16:38 user devstack@n-api.service[61294]: X-Tenant: tempest-DeleteServersTestJSON-1528617807 Apr 18 16:16:38 user devstack@n-api.service[61294]: X-Tenant-Id: eb907be282bb4348976527807993ee58 Apr 18 16:16:38 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-DeleteServersTestJSON-1528617807 Apr 18 16:16:38 user devstack@n-api.service[61294]: X-User: tempest-DeleteServersTestJSON-1528617807-project-member Apr 18 16:16:38 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:16:38 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:16:38 user devstack@n-api.service[61294]: X-User-Id: 045e13d387f04d8eb0709154e4114bf5 Apr 18 16:16:38 user devstack@n-api.service[61294]: X-User-Name: tempest-DeleteServersTestJSON-1528617807-project-member Apr 18 16:16:38 user devstack@n-api.service[61294]: method: > Apr 18 16:16:38 user devstack@n-api.service[61294]: exception: Instance b9feb20a-78c0-44ac-ab87-3a68a14396aa could not be found. Apr 18 16:16:38 user devstack@n-api.service[61294]: action_args: {'id': 'b9feb20a-78c0-44ac-ab87-3a68a14396aa'} Apr 18 16:16:38 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9feb20a-78c0-44ac-ab87-3a68a14396aa could not be found. Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9feb20a-78c0-44ac-ab87-3a68a14396aa could not be found. Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9feb20a-78c0-44ac-ab87-3a68a14396aa could not be found. Apr 18 16:16:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:16:38 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-12106415-c1f7-4489-8228-fe93aecb0e65 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] Returning 404 to user: Instance b9feb20a-78c0-44ac-ab87-3a68a14396aa could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:16:38 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-12106415-c1f7-4489-8228-fe93aecb0e65 tempest-DeleteServersTestJSON-1528617807 tempest-DeleteServersTestJSON-1528617807-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b9feb20a-78c0-44ac-ab87-3a68a14396aa" status: 404 len: 111 microversion: 2.1 time: 0.034932 Apr 18 16:16:38 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 48/143] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:16:38 2023] GET /compute/v2.1/servers/b9feb20a-78c0-44ac-ab87-3a68a14396aa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:16:39 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-54dbddf9-bd9b-4042-9a26-f99abae0bdfb req-e2d6156a-2256-45a1-8092-44f06fb049a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad9c135-f279-4bd8-982d-65b45242adcf", "tag": "21586886-79a5-4cab-bcfe-b52b65fbf177"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:39 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-54dbddf9-bd9b-4042-9a26-f99abae0bdfb req-e2d6156a-2256-45a1-8092-44f06fb049a3 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:39 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-54dbddf9-bd9b-4042-9a26-f99abae0bdfb req-e2d6156a-2256-45a1-8092-44f06fb049a3 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:39 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-54dbddf9-bd9b-4042-9a26-f99abae0bdfb req-e2d6156a-2256-45a1-8092-44f06fb049a3 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:39 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-54dbddf9-bd9b-4042-9a26-f99abae0bdfb req-e2d6156a-2256-45a1-8092-44f06fb049a3 service nova] Creating event network-changed:21586886-79a5-4cab-bcfe-b52b65fbf177 for instance 0ad9c135-f279-4bd8-982d-65b45242adcf on user Apr 18 16:16:39 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-54dbddf9-bd9b-4042-9a26-f99abae0bdfb req-e2d6156a-2256-45a1-8092-44f06fb049a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027051 Apr 18 16:16:39 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 49/144] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:41 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-cf77cf3b-b342-4718-b7b1-bee9bf69ba00 req-d37bbf4b-6a63-442c-963a-43f575d3d7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad9c135-f279-4bd8-982d-65b45242adcf", "name": "network-vif-plugged", "status": "completed", "tag": "21586886-79a5-4cab-bcfe-b52b65fbf177"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-cf77cf3b-b342-4718-b7b1-bee9bf69ba00 req-d37bbf4b-6a63-442c-963a-43f575d3d7c2 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-cf77cf3b-b342-4718-b7b1-bee9bf69ba00 req-d37bbf4b-6a63-442c-963a-43f575d3d7c2 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-cf77cf3b-b342-4718-b7b1-bee9bf69ba00 req-d37bbf4b-6a63-442c-963a-43f575d3d7c2 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:41 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-cf77cf3b-b342-4718-b7b1-bee9bf69ba00 req-d37bbf4b-6a63-442c-963a-43f575d3d7c2 service nova] Creating event network-vif-plugged:21586886-79a5-4cab-bcfe-b52b65fbf177 for instance 0ad9c135-f279-4bd8-982d-65b45242adcf on user Apr 18 16:16:41 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-cf77cf3b-b342-4718-b7b1-bee9bf69ba00 req-d37bbf4b-6a63-442c-963a-43f575d3d7c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034919 Apr 18 16:16:41 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 48/145] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:43 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-886a7820-35c0-47c5-9804-9997ce894c26 req-907df151-834e-440d-827a-6372f338232a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad9c135-f279-4bd8-982d-65b45242adcf", "name": "network-vif-plugged", "status": "completed", "tag": "21586886-79a5-4cab-bcfe-b52b65fbf177"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:43 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:16:43 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-886a7820-35c0-47c5-9804-9997ce894c26 req-907df151-834e-440d-827a-6372f338232a service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:43 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-886a7820-35c0-47c5-9804-9997ce894c26 req-907df151-834e-440d-827a-6372f338232a service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:43 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-886a7820-35c0-47c5-9804-9997ce894c26 req-907df151-834e-440d-827a-6372f338232a service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:43 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:16:43 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-886a7820-35c0-47c5-9804-9997ce894c26 req-907df151-834e-440d-827a-6372f338232a service nova] Creating event network-vif-plugged:21586886-79a5-4cab-bcfe-b52b65fbf177 for instance 0ad9c135-f279-4bd8-982d-65b45242adcf on user Apr 18 16:16:43 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-886a7820-35c0-47c5-9804-9997ce894c26 req-907df151-834e-440d-827a-6372f338232a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037220 Apr 18 16:16:43 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 49/146] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:49 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:16:49 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=6 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:16:49 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:16:49 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:16:49 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-075229d2-c3de-442b-ab75-9327067d81b8 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Action: 'create', calling method: .version_select at 0x7fd6c955fd90>, body: {"keypair": {"name": "tempest-keypair-48834850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM5ALzjyybYMOK2Z1cVTnyDj3Z+LX/Xt2LMBmK17WbJDSTepQBn453Oo4oGngedtyHHoL/jHz286S3ijelgC//rOYsCgxrKNn3otRSI8UvONPGZU5icbqSs6c6+xBe3GQ=="}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:49 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-075229d2-c3de-442b-ab75-9327067d81b8 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Getting quotas for project f9987eeaa6b24ca48e80e8d5318f02ac. Resources: {'key_pairs'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:16:49 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-075229d2-c3de-442b-ab75-9327067d81b8 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Getting quotas for user 73a99bbf510f4f67bb7a35901ba3edc5 and project f9987eeaa6b24ca48e80e8d5318f02ac. Resources: {'key_pairs'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:16:49 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-075229d2-c3de-442b-ab75-9327067d81b8 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.161963 Apr 18 16:16:49 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 50/147] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 18 16:16:49 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 163 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 18 16:16:49 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:16:49 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-68c484a8-f329-4704-9457-4ee5478342f8 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:49 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-68c484a8-f329-4704-9457-4ee5478342f8 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:49 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=17 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:16:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-68c484a8-f329-4704-9457-4ee5478342f8 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-68c484a8-f329-4704-9457-4ee5478342f8 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-68c484a8-f329-4704-9457-4ee5478342f8 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-68c484a8-f329-4704-9457-4ee5478342f8 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-68c484a8-f329-4704-9457-4ee5478342f8 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-68c484a8-f329-4704-9457-4ee5478342f8 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:49 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=25 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:16:49 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-eec03d72-7f66-4f33-97f2-2a019a3835e9 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:49 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-eec03d72-7f66-4f33-97f2-2a019a3835e9 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:49 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-eec03d72-7f66-4f33-97f2-2a019a3835e9 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:49 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-eec03d72-7f66-4f33-97f2-2a019a3835e9 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:49 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-eec03d72-7f66-4f33-97f2-2a019a3835e9 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:49 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-eec03d72-7f66-4f33-97f2-2a019a3835e9 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:49 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-eec03d72-7f66-4f33-97f2-2a019a3835e9 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:49 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-eec03d72-7f66-4f33-97f2-2a019a3835e9 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:50 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-68c484a8-f329-4704-9457-4ee5478342f8 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.210068 Apr 18 16:16:50 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 49/148] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 16:16:49 2023] GET /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c/os-interface => generated 283 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:50 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-eec03d72-7f66-4f33-97f2-2a019a3835e9 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b7b9d8fdcf42f29e83e755f4f27380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa61b19cc4e4cd4bb7d41291c40ef1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:16:50 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-eec03d72-7f66-4f33-97f2-2a019a3835e9 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 200 len: 1658 microversion: 2.1 time: 0.425358 Apr 18 16:16:50 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 50/149] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:16:49 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 1658 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:16:50 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-4ebdfe5b-d58e-4975-92ea-69e7aafca412 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:50 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-4ebdfe5b-d58e-4975-92ea-69e7aafca412 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-4ebdfe5b-d58e-4975-92ea-69e7aafca412 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-4ebdfe5b-d58e-4975-92ea-69e7aafca412 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-4ebdfe5b-d58e-4975-92ea-69e7aafca412 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-4ebdfe5b-d58e-4975-92ea-69e7aafca412 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-4ebdfe5b-d58e-4975-92ea-69e7aafca412 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-4ebdfe5b-d58e-4975-92ea-69e7aafca412 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:50 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-7d6e8e18-2cc3-4648-8fa0-64227d998318 req-b46e3c19-7163-426d-bfb5-3412ac920ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e1ccfc5-90a7-443f-83e2-c07be27d6c7c", "tag": "13606f1d-602f-4c77-b90b-32322653e54e"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:50 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-7d6e8e18-2cc3-4648-8fa0-64227d998318 req-b46e3c19-7163-426d-bfb5-3412ac920ff5 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:50 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-7d6e8e18-2cc3-4648-8fa0-64227d998318 req-b46e3c19-7163-426d-bfb5-3412ac920ff5 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:50 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-7d6e8e18-2cc3-4648-8fa0-64227d998318 req-b46e3c19-7163-426d-bfb5-3412ac920ff5 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:50 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-7d6e8e18-2cc3-4648-8fa0-64227d998318 req-b46e3c19-7163-426d-bfb5-3412ac920ff5 service nova] Creating event network-changed:13606f1d-602f-4c77-b90b-32322653e54e for instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c on user Apr 18 16:16:50 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-7d6e8e18-2cc3-4648-8fa0-64227d998318 req-b46e3c19-7163-426d-bfb5-3412ac920ff5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033165 Apr 18 16:16:50 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 50/150] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:50 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-4ebdfe5b-d58e-4975-92ea-69e7aafca412 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b7b9d8fdcf42f29e83e755f4f27380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa61b19cc4e4cd4bb7d41291c40ef1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:16:50 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-4ebdfe5b-d58e-4975-92ea-69e7aafca412 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 200 len: 1658 microversion: 2.1 time: 0.505193 Apr 18 16:16:50 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 51/151] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:16:50 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 1658 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:16:50 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-92c009e0-3623-4c88-ab4c-0a496abec40d tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:50 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-92c009e0-3623-4c88-ab4c-0a496abec40d tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-92c009e0-3623-4c88-ab4c-0a496abec40d tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-92c009e0-3623-4c88-ab4c-0a496abec40d tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-92c009e0-3623-4c88-ab4c-0a496abec40d tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-92c009e0-3623-4c88-ab4c-0a496abec40d tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-92c009e0-3623-4c88-ab4c-0a496abec40d tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-92c009e0-3623-4c88-ab4c-0a496abec40d tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:50 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-92c009e0-3623-4c88-ab4c-0a496abec40d tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c/ips" status: 200 len: 104 microversion: 2.1 time: 0.047129 Apr 18 16:16:50 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 51/152] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 16:16:50 2023] GET /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c/ips => generated 104 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:51 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-f9b7335a-88c3-41b5-bd90-ce0dffdd1489 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:51 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-f9b7335a-88c3-41b5-bd90-ce0dffdd1489 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: d7a293bf-a9bd-424e-ba11-bbed7dfea41c] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f9b7335a-88c3-41b5-bd90-ce0dffdd1489 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f9b7335a-88c3-41b5-bd90-ce0dffdd1489 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f9b7335a-88c3-41b5-bd90-ce0dffdd1489 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f9b7335a-88c3-41b5-bd90-ce0dffdd1489 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f9b7335a-88c3-41b5-bd90-ce0dffdd1489 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f9b7335a-88c3-41b5-bd90-ce0dffdd1489 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:51 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-f9b7335a-88c3-41b5-bd90-ce0dffdd1489 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3f45f9c6c431781fb582b8da22b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261e8ba82d9e4203917afb0241a3b4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:16:51 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-f9b7335a-88c3-41b5-bd90-ce0dffdd1489 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c" status: 200 len: 1491 microversion: 2.1 time: 0.248568 Apr 18 16:16:51 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 51/153] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:16:51 2023] GET /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c => generated 1491 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:16:51 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1520665803", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "51cddd0f-0e4b-4d37-be40-ce5592263bc2"}], "security_groups": [{"name": "tempest-securitygroup--26093805"}], "key_name": "tempest-keypair-48834850", "user_data": "}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:51 user devstack@n-api.service[61296]: DEBUG nova.network.neutron [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] validate_networks() for [('51cddd0f-0e4b-4d37-be40-ce5592263bc2', None, None, None, None, None)] {{(pid=61296) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Flavor limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Image limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Flavor pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Image pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Getting quotas for project f9987eeaa6b24ca48e80e8d5318f02ac. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Getting quotas for user 73a99bbf510f4f67bb7a35901ba3edc5 and project f9987eeaa6b24ca48e80e8d5318f02ac. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Going to run 1 instances... {{(pid=61296) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: e32196da-a530-4422-8566-5edb01f3cc62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:16:52 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-c24fde5a-f2f8-4a21-b57f-6f5257969f04 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.20 time: 0.614325 Apr 18 16:16:52 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 52/154] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 16:16:51 2023] POST /compute/v2.1/servers => generated 398 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 16:16:52 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-81427e44-625d-44cc-b8ce-010f7770886e tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:52 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-81427e44-625d-44cc-b8ce-010f7770886e tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: e32196da-a530-4422-8566-5edb01f3cc62] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:52 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-81427e44-625d-44cc-b8ce-010f7770886e tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:16:52 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-81427e44-625d-44cc-b8ce-010f7770886e tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:16:52 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-81427e44-625d-44cc-b8ce-010f7770886e tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:16:52 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-81427e44-625d-44cc-b8ce-010f7770886e tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62" status: 200 len: 1274 microversion: 2.20 time: 0.072091 Apr 18 16:16:52 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 52/155] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:16:52 2023] GET /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62 => generated 1274 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:16:52 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-22aa69f8-b70e-4d33-b6bc-a5043060e74b tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:52 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-22aa69f8-b70e-4d33-b6bc-a5043060e74b tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-22aa69f8-b70e-4d33-b6bc-a5043060e74b tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-22aa69f8-b70e-4d33-b6bc-a5043060e74b tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-22aa69f8-b70e-4d33-b6bc-a5043060e74b tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-22aa69f8-b70e-4d33-b6bc-a5043060e74b tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-22aa69f8-b70e-4d33-b6bc-a5043060e74b tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-22aa69f8-b70e-4d33-b6bc-a5043060e74b tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:52 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-22aa69f8-b70e-4d33-b6bc-a5043060e74b tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c] Going to try to terminate instance {{(pid=61295) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:16:52 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-22aa69f8-b70e-4d33-b6bc-a5043060e74b tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c" status: 204 len: 0 microversion: 2.1 time: 0.138650 Apr 18 16:16:52 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 52/156] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:16:52 2023] DELETE /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-ab6e1f05-2f65-4c00-b1f3-5541e2470d89 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-ab6e1f05-2f65-4c00-b1f3-5541e2470d89 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ab6e1f05-2f65-4c00-b1f3-5541e2470d89 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ab6e1f05-2f65-4c00-b1f3-5541e2470d89 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ab6e1f05-2f65-4c00-b1f3-5541e2470d89 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ab6e1f05-2f65-4c00-b1f3-5541e2470d89 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ab6e1f05-2f65-4c00-b1f3-5541e2470d89 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ab6e1f05-2f65-4c00-b1f3-5541e2470d89 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:52 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-ab6e1f05-2f65-4c00-b1f3-5541e2470d89 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd46686fd5b845cca0f3d9452a86f4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82a93c1cb9b4a4da7114874ddf0aa27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:16:52 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-ab6e1f05-2f65-4c00-b1f3-5541e2470d89 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c" status: 200 len: 1662 microversion: 2.1 time: 0.268831 Apr 18 16:16:52 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 53/157] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:16:52 2023] GET /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c => generated 1662 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:16:52 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-871b82ac-6874-471c-8dd4-531c2d8ea002 req-c4fc2e36-c798-42b2-b31e-ce9680965f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e1ccfc5-90a7-443f-83e2-c07be27d6c7c", "name": "network-vif-unplugged", "status": "completed", "tag": "13606f1d-602f-4c77-b90b-32322653e54e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:52 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-871b82ac-6874-471c-8dd4-531c2d8ea002 req-c4fc2e36-c798-42b2-b31e-ce9680965f0b service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:52 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-871b82ac-6874-471c-8dd4-531c2d8ea002 req-c4fc2e36-c798-42b2-b31e-ce9680965f0b service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:52 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-871b82ac-6874-471c-8dd4-531c2d8ea002 req-c4fc2e36-c798-42b2-b31e-ce9680965f0b service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:52 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-871b82ac-6874-471c-8dd4-531c2d8ea002 req-c4fc2e36-c798-42b2-b31e-ce9680965f0b service nova] Creating event network-vif-unplugged:13606f1d-602f-4c77-b90b-32322653e54e for instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c on user Apr 18 16:16:52 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-871b82ac-6874-471c-8dd4-531c2d8ea002 req-c4fc2e36-c798-42b2-b31e-ce9680965f0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050059 Apr 18 16:16:52 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 53/158] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:54 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-45ad7d17-5853-4ad6-9ad9-195fd5a81a1b req-4e8cad93-a9e8-46e4-99a2-11f51e054216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e1ccfc5-90a7-443f-83e2-c07be27d6c7c", "name": "network-vif-deleted", "tag": "13606f1d-602f-4c77-b90b-32322653e54e"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:54 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-45ad7d17-5853-4ad6-9ad9-195fd5a81a1b req-4e8cad93-a9e8-46e4-99a2-11f51e054216 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:54 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-45ad7d17-5853-4ad6-9ad9-195fd5a81a1b req-4e8cad93-a9e8-46e4-99a2-11f51e054216 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:54 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-45ad7d17-5853-4ad6-9ad9-195fd5a81a1b req-4e8cad93-a9e8-46e4-99a2-11f51e054216 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:54 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-45ad7d17-5853-4ad6-9ad9-195fd5a81a1b req-4e8cad93-a9e8-46e4-99a2-11f51e054216 service nova] Creating event network-vif-deleted:13606f1d-602f-4c77-b90b-32322653e54e for instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c on user Apr 18 16:16:54 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-45ad7d17-5853-4ad6-9ad9-195fd5a81a1b req-4e8cad93-a9e8-46e4-99a2-11f51e054216 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039428 Apr 18 16:16:54 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 53/159] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 16:16:54 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-a82fc315-1c74-4dbd-a052-1d25965bd4b3 req-de19b651-1167-4f8a-b713-0f768cac1bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e1ccfc5-90a7-443f-83e2-c07be27d6c7c", "name": "network-vif-plugged", "status": "completed", "tag": "13606f1d-602f-4c77-b90b-32322653e54e"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-a82fc315-1c74-4dbd-a052-1d25965bd4b3 req-de19b651-1167-4f8a-b713-0f768cac1bbc service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-a82fc315-1c74-4dbd-a052-1d25965bd4b3 req-de19b651-1167-4f8a-b713-0f768cac1bbc service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-a82fc315-1c74-4dbd-a052-1d25965bd4b3 req-de19b651-1167-4f8a-b713-0f768cac1bbc service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:55 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-a82fc315-1c74-4dbd-a052-1d25965bd4b3 req-de19b651-1167-4f8a-b713-0f768cac1bbc service nova] Creating event network-vif-plugged:13606f1d-602f-4c77-b90b-32322653e54e for instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c on user Apr 18 16:16:55 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-a82fc315-1c74-4dbd-a052-1d25965bd4b3 req-de19b651-1167-4f8a-b713-0f768cac1bbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028184 Apr 18 16:16:55 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 54/160] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:55 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-78066695-52a0-49ea-a770-5b08be803098 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:55 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-78066695-52a0-49ea-a770-5b08be803098 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] [instance: 8aaa4e97-9439-4760-9e05-8b248b02074f] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-78066695-52a0-49ea-a770-5b08be803098 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-78066695-52a0-49ea-a770-5b08be803098 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-78066695-52a0-49ea-a770-5b08be803098 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-78066695-52a0-49ea-a770-5b08be803098 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-78066695-52a0-49ea-a770-5b08be803098 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-78066695-52a0-49ea-a770-5b08be803098 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:55 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-78066695-52a0-49ea-a770-5b08be803098 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.232656 Apr 18 16:16:55 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 54/161] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 16:16:55 2023] GET /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f/os-interface => generated 283 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:56 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-5f11fa2c-2912-42d6-a26b-7e500d56e5c0 req-bf74449d-3170-4026-a8be-9839e3fa7290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aaa4e97-9439-4760-9e05-8b248b02074f", "tag": "8029e455-c16d-48cd-93e1-cf56c226cc4a"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:56 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-5f11fa2c-2912-42d6-a26b-7e500d56e5c0 req-bf74449d-3170-4026-a8be-9839e3fa7290 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:56 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-5f11fa2c-2912-42d6-a26b-7e500d56e5c0 req-bf74449d-3170-4026-a8be-9839e3fa7290 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:56 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-5f11fa2c-2912-42d6-a26b-7e500d56e5c0 req-bf74449d-3170-4026-a8be-9839e3fa7290 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:56 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-5f11fa2c-2912-42d6-a26b-7e500d56e5c0 req-bf74449d-3170-4026-a8be-9839e3fa7290 service nova] Creating event network-changed:8029e455-c16d-48cd-93e1-cf56c226cc4a for instance 8aaa4e97-9439-4760-9e05-8b248b02074f on user Apr 18 16:16:56 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-5f11fa2c-2912-42d6-a26b-7e500d56e5c0 req-bf74449d-3170-4026-a8be-9839e3fa7290 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034021 Apr 18 16:16:56 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 54/162] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:56 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-59d8e518-4715-41b3-9100-602e3a8747a7 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1132921254"}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:56 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-59d8e518-4715-41b3-9100-602e3a8747a7 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] [instance: 8aaa4e97-9439-4760-9e05-8b248b02074f] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:16:56 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-59d8e518-4715-41b3-9100-602e3a8747a7 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:56 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-59d8e518-4715-41b3-9100-602e3a8747a7 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:56 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-59d8e518-4715-41b3-9100-602e3a8747a7 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:56 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-59d8e518-4715-41b3-9100-602e3a8747a7 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:56 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-59d8e518-4715-41b3-9100-602e3a8747a7 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:56 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-59d8e518-4715-41b3-9100-602e3a8747a7 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:57 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-751e2e18-07af-4145-8c4e-1b49e5284dbf req-482bba64-9449-4b5e-a9ef-25801c1a9e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32196da-a530-4422-8566-5edb01f3cc62", "tag": "203a232c-488a-427e-bf18-e99feec680b6"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-751e2e18-07af-4145-8c4e-1b49e5284dbf req-482bba64-9449-4b5e-a9ef-25801c1a9e1a service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-751e2e18-07af-4145-8c4e-1b49e5284dbf req-482bba64-9449-4b5e-a9ef-25801c1a9e1a service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-751e2e18-07af-4145-8c4e-1b49e5284dbf req-482bba64-9449-4b5e-a9ef-25801c1a9e1a service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:57 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-751e2e18-07af-4145-8c4e-1b49e5284dbf req-482bba64-9449-4b5e-a9ef-25801c1a9e1a service nova] Creating event network-changed:203a232c-488a-427e-bf18-e99feec680b6 for instance e32196da-a530-4422-8566-5edb01f3cc62 on user Apr 18 16:16:57 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-751e2e18-07af-4145-8c4e-1b49e5284dbf req-482bba64-9449-4b5e-a9ef-25801c1a9e1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056630 Apr 18 16:16:57 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 55/163] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:16:57 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-2473d97e-7f2d-4e59-b1d1-5de0291d2851 req-faa749fb-3d81-4326-ba3e-562fa1b3fcdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32196da-a530-4422-8566-5edb01f3cc62", "name": "network-vif-plugged", "status": "completed", "tag": "203a232c-488a-427e-bf18-e99feec680b6"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:57 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-2473d97e-7f2d-4e59-b1d1-5de0291d2851 req-faa749fb-3d81-4326-ba3e-562fa1b3fcdb service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:57 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-2473d97e-7f2d-4e59-b1d1-5de0291d2851 req-faa749fb-3d81-4326-ba3e-562fa1b3fcdb service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:57 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-2473d97e-7f2d-4e59-b1d1-5de0291d2851 req-faa749fb-3d81-4326-ba3e-562fa1b3fcdb service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:57 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-59d8e518-4715-41b3-9100-602e3a8747a7 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f/action" status: 202 len: 0 microversion: 2.1 time: 0.916215 Apr 18 16:16:57 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 55/164] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 18 16:16:56 2023] POST /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f/action => generated 0 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 18 16:16:57 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-bb7fd6e0-6431-4388-9231-0dfe46e3e5f2 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Calling method '.version_select at 0x7fd6c9519a20>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:16:57 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-2473d97e-7f2d-4e59-b1d1-5de0291d2851 req-faa749fb-3d81-4326-ba3e-562fa1b3fcdb service nova] Creating event network-vif-plugged:203a232c-488a-427e-bf18-e99feec680b6 for instance e32196da-a530-4422-8566-5edb01f3cc62 on user Apr 18 16:16:57 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-2473d97e-7f2d-4e59-b1d1-5de0291d2851 req-faa749fb-3d81-4326-ba3e-562fa1b3fcdb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061935 Apr 18 16:16:57 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 55/165] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 16:16:57 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-bb7fd6e0-6431-4388-9231-0dfe46e3e5f2 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] 10.0.0.210 "GET /compute/v2.1/images/07d730fa-d89b-4e7e-a501-30edbfdbfe9e" status: 200 len: 1611 microversion: 2.1 time: 0.068466 Apr 18 16:16:57 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 56/166] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 16:16:57 2023] GET /compute/v2.1/images/07d730fa-d89b-4e7e-a501-30edbfdbfe9e => generated 1611 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:16:59 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-92d28f7f-01ec-4e48-8593-6d71e7d394cc req-be9012f6-fbaa-43a6-a3b7-9c48b0b36e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32196da-a530-4422-8566-5edb01f3cc62", "name": "network-vif-plugged", "status": "completed", "tag": "203a232c-488a-427e-bf18-e99feec680b6"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:16:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-92d28f7f-01ec-4e48-8593-6d71e7d394cc req-be9012f6-fbaa-43a6-a3b7-9c48b0b36e34 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:16:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-92d28f7f-01ec-4e48-8593-6d71e7d394cc req-be9012f6-fbaa-43a6-a3b7-9c48b0b36e34 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:16:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-92d28f7f-01ec-4e48-8593-6d71e7d394cc req-be9012f6-fbaa-43a6-a3b7-9c48b0b36e34 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:16:59 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-92d28f7f-01ec-4e48-8593-6d71e7d394cc req-be9012f6-fbaa-43a6-a3b7-9c48b0b36e34 service nova] Creating event network-vif-plugged:203a232c-488a-427e-bf18-e99feec680b6 for instance e32196da-a530-4422-8566-5edb01f3cc62 on user Apr 18 16:16:59 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-92d28f7f-01ec-4e48-8593-6d71e7d394cc req-be9012f6-fbaa-43a6-a3b7-9c48b0b36e34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034405 Apr 18 16:16:59 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 56/167] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:16:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:17:06 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-34ac14a6-9220-4e6f-86d3-7c630b7306cf tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:06 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-34ac14a6-9220-4e6f-86d3-7c630b7306cf tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: 993d062c-8462-4534-bcde-9249779d4e90] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:17:06 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-34ac14a6-9220-4e6f-86d3-7c630b7306cf tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:06 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-34ac14a6-9220-4e6f-86d3-7c630b7306cf tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:06 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-34ac14a6-9220-4e6f-86d3-7c630b7306cf tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:06 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-34ac14a6-9220-4e6f-86d3-7c630b7306cf tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:06 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-34ac14a6-9220-4e6f-86d3-7c630b7306cf tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:06 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-34ac14a6-9220-4e6f-86d3-7c630b7306cf tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:06 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-34ac14a6-9220-4e6f-86d3-7c630b7306cf tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] HTTP exception thrown: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. Apr 18 16:17:06 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-34ac14a6-9220-4e6f-86d3-7c630b7306cf tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Request method failure captured: Apr 18 16:17:06 user devstack@n-api.service[61295]: request: GET /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90 HTTP/1.1 Apr 18 16:17:06 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:17:06 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:17:06 user devstack@n-api.service[61295]: Connection: close Apr 18 16:17:06 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:17:06 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:17:06 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:17:06 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:17:06 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:17:06 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsHTZ7piGp01Yhd4R65i1j6b1tm_mMC4UdZnSeVxAUqrjcgOgLCuqXk0nrLp3WWbo5cJrYSMAj1QaNQisCM4wiIgBJFWpK96pq4PU3dacvENZhQvIWTlb95XqutwUJW_QMqFtqglLPmnY7p8o40n_yxwAZ-6Her-cOHvYNFFN0lubNw Apr 18 16:17:06 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:17:06 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:17:06 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:17:06 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:17:06 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:17:06 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:17:06 user devstack@n-api.service[61295]: X-Project-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:17:06 user devstack@n-api.service[61295]: X-Project-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:17:06 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:17:06 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:17:06 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:17:06 user devstack@n-api.service[61295]: X-Tenant: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:17:06 user devstack@n-api.service[61295]: X-Tenant-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:17:06 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:17:06 user devstack@n-api.service[61295]: X-User: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:17:06 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:17:06 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:17:06 user devstack@n-api.service[61295]: X-User-Id: af90e17ec027463fa8793e8539c39e13 Apr 18 16:17:06 user devstack@n-api.service[61295]: X-User-Name: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:17:06 user devstack@n-api.service[61295]: method: > Apr 18 16:17:06 user devstack@n-api.service[61295]: exception: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. Apr 18 16:17:06 user devstack@n-api.service[61295]: action_args: {'id': '993d062c-8462-4534-bcde-9249779d4e90'} Apr 18 16:17:06 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. Apr 18 16:17:06 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:17:06 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-34ac14a6-9220-4e6f-86d3-7c630b7306cf tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Returning 404 to user: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:17:06 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-34ac14a6-9220-4e6f-86d3-7c630b7306cf tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90" status: 404 len: 111 microversion: 2.1 time: 0.036414 Apr 18 16:17:06 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 56/168] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:17:06 2023] GET /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:17:06 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:06 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-3369fda6-a3d9-4a5b-8327-3be81242549f tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '.version_select at 0x7fd6c94e0af0>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:06 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-3369fda6-a3d9-4a5b-8327-3be81242549f tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-87186417" status: 202 len: 0 microversion: 2.1 time: 0.022390 Apr 18 16:17:06 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 57/169] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Apr 18 16:17:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-87186417 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:17:07 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-0a5caa3e-a04d-4715-bc0f-91a3e7e4125c tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Action: 'create', calling method: .version_select at 0x7fd6c955d510>, body: {"keypair": {"name": "tempest-keypair-1742241088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2SDBHv75l7hW3tiq5hWHFRDYyei1QQIo9CQRQFQISK8RVXUcgtsJBeI8pkGbxlcETA/pFpFNDAjbdgyUlN3UoIYqsksl/hRT8/J7etZF7prNIypo7A3UV/2lzY82gGhg=="}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:17:07 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:07 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=10 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:07 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-0a5caa3e-a04d-4715-bc0f-91a3e7e4125c tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Getting quotas for project 6b4e8d8797be4c0e91b1401538f2eba8. Resources: {'key_pairs'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:17:07 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-0a5caa3e-a04d-4715-bc0f-91a3e7e4125c tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Getting quotas for user af90e17ec027463fa8793e8539c39e13 and project 6b4e8d8797be4c0e91b1401538f2eba8. Resources: {'key_pairs'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:17:07 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-0a5caa3e-a04d-4715-bc0f-91a3e7e4125c tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112371 Apr 18 16:17:07 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 57/170] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 16:17:07 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-14343453", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "02aca424-2923-404b-9c66-76bec89f82b7"}], "security_groups": [{"name": "tempest-securitygroup--1297063339"}], "key_name": "tempest-keypair-1742241088", "user_data": "}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG nova.network.neutron [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] validate_networks() for [('02aca424-2923-404b-9c66-76bec89f82b7', None, None, None, None, None)] {{(pid=61295) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Flavor limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Image limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Flavor pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Image pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Getting quotas for project 6b4e8d8797be4c0e91b1401538f2eba8. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Getting quotas for user af90e17ec027463fa8793e8539c39e13 and project 6b4e8d8797be4c0e91b1401538f2eba8. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Going to run 1 instances... {{(pid=61295) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:17:09 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:17:09 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-15398257-0711-4956-963c-876a15c8f6d3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.846764 Apr 18 16:17:09 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 57/171] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:17:09 2023] POST /compute/v2.1/servers => generated 400 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:17:09 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=19 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:09 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-c9c33124-0cbe-4d2c-9183-b55659737592 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:09 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-c9c33124-0cbe-4d2c-9183-b55659737592 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:17:09 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-c9c33124-0cbe-4d2c-9183-b55659737592 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af90e17ec027463fa8793e8539c39e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4e8d8797be4c0e91b1401538f2eba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:17:09 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-c9c33124-0cbe-4d2c-9183-b55659737592 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc" status: 200 len: 1234 microversion: 2.1 time: 0.062908 Apr 18 16:17:09 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 58/172] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:17:09 2023] GET /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc => generated 1234 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:17:12 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:12 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-e72d73b0-7589-4eb4-96e1-2df741e4ddfb req-1a94bb37-f496-4d35-8661-c45fbabe8839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc", "tag": "bfcdfd2e-b438-4386-bcae-7088ec17c0e6"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:17:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-e72d73b0-7589-4eb4-96e1-2df741e4ddfb req-1a94bb37-f496-4d35-8661-c45fbabe8839 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-e72d73b0-7589-4eb4-96e1-2df741e4ddfb req-1a94bb37-f496-4d35-8661-c45fbabe8839 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:12 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-e72d73b0-7589-4eb4-96e1-2df741e4ddfb req-1a94bb37-f496-4d35-8661-c45fbabe8839 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:12 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-e72d73b0-7589-4eb4-96e1-2df741e4ddfb req-1a94bb37-f496-4d35-8661-c45fbabe8839 service nova] Creating event network-changed:bfcdfd2e-b438-4386-bcae-7088ec17c0e6 for instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc on user Apr 18 16:17:12 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-e72d73b0-7589-4eb4-96e1-2df741e4ddfb req-1a94bb37-f496-4d35-8661-c45fbabe8839 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057762 Apr 18 16:17:12 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 58/173] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:17:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:17:14 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-026951b8-440a-4fda-b247-a7560cffc441 req-b087aef4-8d77-4c56-b65d-211aa5a69212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc", "name": "network-vif-plugged", "status": "completed", "tag": "bfcdfd2e-b438-4386-bcae-7088ec17c0e6"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:17:14 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-026951b8-440a-4fda-b247-a7560cffc441 req-b087aef4-8d77-4c56-b65d-211aa5a69212 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:14 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-026951b8-440a-4fda-b247-a7560cffc441 req-b087aef4-8d77-4c56-b65d-211aa5a69212 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:14 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-026951b8-440a-4fda-b247-a7560cffc441 req-b087aef4-8d77-4c56-b65d-211aa5a69212 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:14 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-026951b8-440a-4fda-b247-a7560cffc441 req-b087aef4-8d77-4c56-b65d-211aa5a69212 service nova] Creating event network-vif-plugged:bfcdfd2e-b438-4386-bcae-7088ec17c0e6 for instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc on user Apr 18 16:17:14 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-026951b8-440a-4fda-b247-a7560cffc441 req-b087aef4-8d77-4c56-b65d-211aa5a69212 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041207 Apr 18 16:17:14 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 58/174] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:17:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:17:16 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-332809a1-5c1f-46c9-94b5-0b696a7e6d72 req-89442140-9e89-49f4-9889-2e6cd0fbf183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc", "name": "network-vif-plugged", "status": "completed", "tag": "bfcdfd2e-b438-4386-bcae-7088ec17c0e6"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:17:16 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-332809a1-5c1f-46c9-94b5-0b696a7e6d72 req-89442140-9e89-49f4-9889-2e6cd0fbf183 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:16 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-332809a1-5c1f-46c9-94b5-0b696a7e6d72 req-89442140-9e89-49f4-9889-2e6cd0fbf183 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:16 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-332809a1-5c1f-46c9-94b5-0b696a7e6d72 req-89442140-9e89-49f4-9889-2e6cd0fbf183 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:16 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-332809a1-5c1f-46c9-94b5-0b696a7e6d72 req-89442140-9e89-49f4-9889-2e6cd0fbf183 service nova] Creating event network-vif-plugged:bfcdfd2e-b438-4386-bcae-7088ec17c0e6 for instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc on user Apr 18 16:17:16 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-332809a1-5c1f-46c9-94b5-0b696a7e6d72 req-89442140-9e89-49f4-9889-2e6cd0fbf183 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027690 Apr 18 16:17:16 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 59/175] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:17:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:17:19 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-ce78f957-1bf7-4266-99a4-d0bdceedbde7 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:19 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-ce78f957-1bf7-4266-99a4-d0bdceedbde7 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] [instance: aaac3797-349f-4695-bea2-8b0c022a66e0] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:17:19 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=4 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:19 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ce78f957-1bf7-4266-99a4-d0bdceedbde7 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:19 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ce78f957-1bf7-4266-99a4-d0bdceedbde7 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:19 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ce78f957-1bf7-4266-99a4-d0bdceedbde7 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:19 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ce78f957-1bf7-4266-99a4-d0bdceedbde7 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:19 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ce78f957-1bf7-4266-99a4-d0bdceedbde7 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:19 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ce78f957-1bf7-4266-99a4-d0bdceedbde7 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:19 user devstack@n-api.service[61296]: INFO nova.api.openstack.wsgi [None req-ce78f957-1bf7-4266-99a4-d0bdceedbde7 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] HTTP exception thrown: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. Apr 18 16:17:19 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-ce78f957-1bf7-4266-99a4-d0bdceedbde7 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Request method failure captured: Apr 18 16:17:19 user devstack@n-api.service[61296]: request: GET /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0 HTTP/1.1 Apr 18 16:17:19 user devstack@n-api.service[61296]: Accept: application/json Apr 18 16:17:19 user devstack@n-api.service[61296]: Accept-Encoding: identity Apr 18 16:17:19 user devstack@n-api.service[61296]: Connection: close Apr 18 16:17:19 user devstack@n-api.service[61296]: Content-Length: 0 Apr 18 16:17:19 user devstack@n-api.service[61296]: Content-Type: application/json Apr 18 16:17:19 user devstack@n-api.service[61296]: Host: 10.0.0.210 Apr 18 16:17:19 user devstack@n-api.service[61296]: Openstack-System-Scope: None Apr 18 16:17:19 user devstack@n-api.service[61296]: User-Agent: python-urllib3/1.26.15 Apr 18 16:17:19 user devstack@n-api.service[61296]: X-Auth-Token: gAAAAABkPsHLw2T-PhpBUsQIuKcL9ybjeAjKigZPbZiyiYSqkx_CnFlCfwebZ8uDnN6fRe3Fq6U4KqxpoipRaEMw7i-z3H95hzXLR_mgJKqe3E6CmhU4YP5Sj8VWP5iBXDV3T5zDK-p6K3GnL_diKPEb2Js_jrVmzeVNivW-IOi6BahQIcInwBc Apr 18 16:17:19 user devstack@n-api.service[61296]: X-Domain-Id: None Apr 18 16:17:19 user devstack@n-api.service[61296]: X-Domain-Name: None Apr 18 16:17:19 user devstack@n-api.service[61296]: X-Identity-Status: Confirmed Apr 18 16:17:19 user devstack@n-api.service[61296]: X-Is-Admin-Project: True Apr 18 16:17:19 user devstack@n-api.service[61296]: X-Project-Domain-Id: default Apr 18 16:17:19 user devstack@n-api.service[61296]: X-Project-Domain-Name: Default Apr 18 16:17:19 user devstack@n-api.service[61296]: X-Project-Id: 8b357cc820a04f3486f98d8e38c1a3d6 Apr 18 16:17:19 user devstack@n-api.service[61296]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-344223138 Apr 18 16:17:19 user devstack@n-api.service[61296]: X-Role: reader,member Apr 18 16:17:19 user devstack@n-api.service[61296]: X-Roles: reader,member Apr 18 16:17:19 user devstack@n-api.service[61296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8b357cc820a04f3486f98d8e38c1a3d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8b357cc820a04f3486f98d8e38c1a3d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8b357cc820a04f3486f98d8e38c1a3d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:17:19 user devstack@n-api.service[61296]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-344223138 Apr 18 16:17:19 user devstack@n-api.service[61296]: X-Tenant-Id: 8b357cc820a04f3486f98d8e38c1a3d6 Apr 18 16:17:19 user devstack@n-api.service[61296]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-344223138 Apr 18 16:17:19 user devstack@n-api.service[61296]: X-User: tempest-AttachSCSIVolumeTestJSON-344223138-project-member Apr 18 16:17:19 user devstack@n-api.service[61296]: X-User-Domain-Id: default Apr 18 16:17:19 user devstack@n-api.service[61296]: X-User-Domain-Name: Default Apr 18 16:17:19 user devstack@n-api.service[61296]: X-User-Id: ffaa9df682cb40739d1d754000e04743 Apr 18 16:17:19 user devstack@n-api.service[61296]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-344223138-project-member Apr 18 16:17:19 user devstack@n-api.service[61296]: method: > Apr 18 16:17:19 user devstack@n-api.service[61296]: exception: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. Apr 18 16:17:19 user devstack@n-api.service[61296]: action_args: {'id': 'aaac3797-349f-4695-bea2-8b0c022a66e0'} Apr 18 16:17:19 user devstack@n-api.service[61296]: {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. Apr 18 16:17:19 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:17:19 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-ce78f957-1bf7-4266-99a4-d0bdceedbde7 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Returning 404 to user: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. {{(pid=61296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:17:19 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-ce78f957-1bf7-4266-99a4-d0bdceedbde7 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0" status: 404 len: 111 microversion: 2.1 time: 0.039847 Apr 18 16:17:19 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 59/176] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:17:19 2023] GET /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:17:19 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-d70fd60a-55fd-4dce-bdb2-009696f1ee6b tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Calling method '.version_select at 0x7fd6c93324d0>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:19 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-d70fd60a-55fd-4dce-bdb2-009696f1ee6b tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-566143322" status: 202 len: 0 microversion: 2.1 time: 0.056649 Apr 18 16:17:19 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 59/177] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 16:17:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-566143322 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:17:20 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:20 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-2dcd2d9b-3c36-4b64-b847-92e07d0017a4 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:20 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-2dcd2d9b-3c36-4b64-b847-92e07d0017a4 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] [instance: aaac3797-349f-4695-bea2-8b0c022a66e0] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:17:20 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-2dcd2d9b-3c36-4b64-b847-92e07d0017a4 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-2dcd2d9b-3c36-4b64-b847-92e07d0017a4 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-2dcd2d9b-3c36-4b64-b847-92e07d0017a4 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-2dcd2d9b-3c36-4b64-b847-92e07d0017a4 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-2dcd2d9b-3c36-4b64-b847-92e07d0017a4 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-2dcd2d9b-3c36-4b64-b847-92e07d0017a4 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:20 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-2dcd2d9b-3c36-4b64-b847-92e07d0017a4 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] HTTP exception thrown: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. Apr 18 16:17:20 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-2dcd2d9b-3c36-4b64-b847-92e07d0017a4 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Request method failure captured: Apr 18 16:17:20 user devstack@n-api.service[61294]: request: DELETE /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0 HTTP/1.1 Apr 18 16:17:20 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:17:20 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:17:20 user devstack@n-api.service[61294]: Connection: close Apr 18 16:17:20 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:17:20 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:17:20 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:17:20 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:17:20 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:17:20 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsHLw2T-PhpBUsQIuKcL9ybjeAjKigZPbZiyiYSqkx_CnFlCfwebZ8uDnN6fRe3Fq6U4KqxpoipRaEMw7i-z3H95hzXLR_mgJKqe3E6CmhU4YP5Sj8VWP5iBXDV3T5zDK-p6K3GnL_diKPEb2Js_jrVmzeVNivW-IOi6BahQIcInwBc Apr 18 16:17:20 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:17:20 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:17:20 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:17:20 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:17:20 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:17:20 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:17:20 user devstack@n-api.service[61294]: X-Project-Id: 8b357cc820a04f3486f98d8e38c1a3d6 Apr 18 16:17:20 user devstack@n-api.service[61294]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-344223138 Apr 18 16:17:20 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:17:20 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:17:20 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8b357cc820a04f3486f98d8e38c1a3d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8b357cc820a04f3486f98d8e38c1a3d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8b357cc820a04f3486f98d8e38c1a3d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:17:20 user devstack@n-api.service[61294]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-344223138 Apr 18 16:17:20 user devstack@n-api.service[61294]: X-Tenant-Id: 8b357cc820a04f3486f98d8e38c1a3d6 Apr 18 16:17:20 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-344223138 Apr 18 16:17:20 user devstack@n-api.service[61294]: X-User: tempest-AttachSCSIVolumeTestJSON-344223138-project-member Apr 18 16:17:20 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:17:20 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:17:20 user devstack@n-api.service[61294]: X-User-Id: ffaa9df682cb40739d1d754000e04743 Apr 18 16:17:20 user devstack@n-api.service[61294]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-344223138-project-member Apr 18 16:17:20 user devstack@n-api.service[61294]: method: > Apr 18 16:17:20 user devstack@n-api.service[61294]: exception: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. Apr 18 16:17:20 user devstack@n-api.service[61294]: action_args: {'id': 'aaac3797-349f-4695-bea2-8b0c022a66e0'} Apr 18 16:17:20 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. Apr 18 16:17:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:17:20 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-2dcd2d9b-3c36-4b64-b847-92e07d0017a4 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Returning 404 to user: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:17:20 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-2dcd2d9b-3c36-4b64-b847-92e07d0017a4 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0" status: 404 len: 111 microversion: 2.1 time: 0.040169 Apr 18 16:17:20 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 60/178] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:17:20 2023] DELETE /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:17:20 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-1bf5cb9e-1481-4350-99ea-62633690cbb1 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:20 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-1bf5cb9e-1481-4350-99ea-62633690cbb1 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] [instance: aaac3797-349f-4695-bea2-8b0c022a66e0] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:17:20 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=5 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:20 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-1bf5cb9e-1481-4350-99ea-62633690cbb1 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:20 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-1bf5cb9e-1481-4350-99ea-62633690cbb1 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:20 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-1bf5cb9e-1481-4350-99ea-62633690cbb1 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:20 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-1bf5cb9e-1481-4350-99ea-62633690cbb1 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:20 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-1bf5cb9e-1481-4350-99ea-62633690cbb1 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:20 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-1bf5cb9e-1481-4350-99ea-62633690cbb1 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:20 user devstack@n-api.service[61296]: INFO nova.api.openstack.wsgi [None req-1bf5cb9e-1481-4350-99ea-62633690cbb1 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] HTTP exception thrown: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. Apr 18 16:17:20 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-1bf5cb9e-1481-4350-99ea-62633690cbb1 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Request method failure captured: Apr 18 16:17:20 user devstack@n-api.service[61296]: request: GET /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0 HTTP/1.1 Apr 18 16:17:20 user devstack@n-api.service[61296]: Accept: application/json Apr 18 16:17:20 user devstack@n-api.service[61296]: Accept-Encoding: identity Apr 18 16:17:20 user devstack@n-api.service[61296]: Connection: close Apr 18 16:17:20 user devstack@n-api.service[61296]: Content-Length: 0 Apr 18 16:17:20 user devstack@n-api.service[61296]: Content-Type: application/json Apr 18 16:17:20 user devstack@n-api.service[61296]: Host: 10.0.0.210 Apr 18 16:17:20 user devstack@n-api.service[61296]: Openstack-System-Scope: None Apr 18 16:17:20 user devstack@n-api.service[61296]: User-Agent: python-urllib3/1.26.15 Apr 18 16:17:20 user devstack@n-api.service[61296]: X-Auth-Token: gAAAAABkPsHLw2T-PhpBUsQIuKcL9ybjeAjKigZPbZiyiYSqkx_CnFlCfwebZ8uDnN6fRe3Fq6U4KqxpoipRaEMw7i-z3H95hzXLR_mgJKqe3E6CmhU4YP5Sj8VWP5iBXDV3T5zDK-p6K3GnL_diKPEb2Js_jrVmzeVNivW-IOi6BahQIcInwBc Apr 18 16:17:20 user devstack@n-api.service[61296]: X-Domain-Id: None Apr 18 16:17:20 user devstack@n-api.service[61296]: X-Domain-Name: None Apr 18 16:17:20 user devstack@n-api.service[61296]: X-Identity-Status: Confirmed Apr 18 16:17:20 user devstack@n-api.service[61296]: X-Is-Admin-Project: True Apr 18 16:17:20 user devstack@n-api.service[61296]: X-Project-Domain-Id: default Apr 18 16:17:20 user devstack@n-api.service[61296]: X-Project-Domain-Name: Default Apr 18 16:17:20 user devstack@n-api.service[61296]: X-Project-Id: 8b357cc820a04f3486f98d8e38c1a3d6 Apr 18 16:17:20 user devstack@n-api.service[61296]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-344223138 Apr 18 16:17:20 user devstack@n-api.service[61296]: X-Role: reader,member Apr 18 16:17:20 user devstack@n-api.service[61296]: X-Roles: reader,member Apr 18 16:17:20 user devstack@n-api.service[61296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8b357cc820a04f3486f98d8e38c1a3d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8b357cc820a04f3486f98d8e38c1a3d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8b357cc820a04f3486f98d8e38c1a3d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:17:20 user devstack@n-api.service[61296]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-344223138 Apr 18 16:17:20 user devstack@n-api.service[61296]: X-Tenant-Id: 8b357cc820a04f3486f98d8e38c1a3d6 Apr 18 16:17:20 user devstack@n-api.service[61296]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-344223138 Apr 18 16:17:20 user devstack@n-api.service[61296]: X-User: tempest-AttachSCSIVolumeTestJSON-344223138-project-member Apr 18 16:17:20 user devstack@n-api.service[61296]: X-User-Domain-Id: default Apr 18 16:17:20 user devstack@n-api.service[61296]: X-User-Domain-Name: Default Apr 18 16:17:20 user devstack@n-api.service[61296]: X-User-Id: ffaa9df682cb40739d1d754000e04743 Apr 18 16:17:20 user devstack@n-api.service[61296]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-344223138-project-member Apr 18 16:17:20 user devstack@n-api.service[61296]: method: > Apr 18 16:17:20 user devstack@n-api.service[61296]: exception: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. Apr 18 16:17:20 user devstack@n-api.service[61296]: action_args: {'id': 'aaac3797-349f-4695-bea2-8b0c022a66e0'} Apr 18 16:17:20 user devstack@n-api.service[61296]: {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. Apr 18 16:17:20 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:17:20 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-1bf5cb9e-1481-4350-99ea-62633690cbb1 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] Returning 404 to user: Instance aaac3797-349f-4695-bea2-8b0c022a66e0 could not be found. {{(pid=61296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:17:20 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-1bf5cb9e-1481-4350-99ea-62633690cbb1 tempest-AttachSCSIVolumeTestJSON-344223138 tempest-AttachSCSIVolumeTestJSON-344223138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0" status: 404 len: 111 microversion: 2.1 time: 0.034061 Apr 18 16:17:20 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 60/179] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:17:20 2023] GET /compute/v2.1/servers/aaac3797-349f-4695-bea2-8b0c022a66e0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:17:27 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:27 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=6 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:27 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:27 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-faf6c09e-bb8e-4076-b0a5-d05915b03197 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:27 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-faf6c09e-bb8e-4076-b0a5-d05915b03197 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] [instance: 0ad9c135-f279-4bd8-982d-65b45242adcf] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:17:27 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:27 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-faf6c09e-bb8e-4076-b0a5-d05915b03197 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:27 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-faf6c09e-bb8e-4076-b0a5-d05915b03197 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:27 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-faf6c09e-bb8e-4076-b0a5-d05915b03197 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:27 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-faf6c09e-bb8e-4076-b0a5-d05915b03197 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:27 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-faf6c09e-bb8e-4076-b0a5-d05915b03197 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:27 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-faf6c09e-bb8e-4076-b0a5-d05915b03197 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:27 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-faf6c09e-bb8e-4076-b0a5-d05915b03197 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299ba2e202244f59a09e22df9ea8efe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf93a24e754e1ea58c0a7fd4f553dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:17:27 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-faf6c09e-bb8e-4076-b0a5-d05915b03197 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ad9c135-f279-4bd8-982d-65b45242adcf" status: 200 len: 1494 microversion: 2.1 time: 0.372384 Apr 18 16:17:27 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 60/180] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:17:27 2023] GET /compute/v2.1/servers/0ad9c135-f279-4bd8-982d-65b45242adcf => generated 1494 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:17:42 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-ee29ab7f-0f9b-48fa-ad1b-9d031fc9624b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:42 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-ee29ab7f-0f9b-48fa-ad1b-9d031fc9624b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: e32196da-a530-4422-8566-5edb01f3cc62] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:17:42 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=1 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:42 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=4 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ee29ab7f-0f9b-48fa-ad1b-9d031fc9624b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ee29ab7f-0f9b-48fa-ad1b-9d031fc9624b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ee29ab7f-0f9b-48fa-ad1b-9d031fc9624b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ee29ab7f-0f9b-48fa-ad1b-9d031fc9624b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ee29ab7f-0f9b-48fa-ad1b-9d031fc9624b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ee29ab7f-0f9b-48fa-ad1b-9d031fc9624b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:42 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-ee29ab7f-0f9b-48fa-ad1b-9d031fc9624b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:17:42 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-ee29ab7f-0f9b-48fa-ad1b-9d031fc9624b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:17:42 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-ee29ab7f-0f9b-48fa-ad1b-9d031fc9624b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:17:42 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-ee29ab7f-0f9b-48fa-ad1b-9d031fc9624b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62" status: 200 len: 1584 microversion: 2.20 time: 0.323499 Apr 18 16:17:42 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 61/181] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:17:42 2023] GET /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62 => generated 1584 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:17:42 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-191f7925-cb10-47fd-9268-53a32d34f08e tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:42 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-191f7925-cb10-47fd-9268-53a32d34f08e tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:17:42 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:42 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=6 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-191f7925-cb10-47fd-9268-53a32d34f08e tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:43 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-191f7925-cb10-47fd-9268-53a32d34f08e tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:43 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-191f7925-cb10-47fd-9268-53a32d34f08e tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:43 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-191f7925-cb10-47fd-9268-53a32d34f08e tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:43 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-191f7925-cb10-47fd-9268-53a32d34f08e tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:43 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-191f7925-cb10-47fd-9268-53a32d34f08e tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:43 user devstack@n-api.service[61296]: INFO nova.api.openstack.wsgi [None req-191f7925-cb10-47fd-9268-53a32d34f08e tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] HTTP exception thrown: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. Apr 18 16:17:43 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-191f7925-cb10-47fd-9268-53a32d34f08e tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Request method failure captured: Apr 18 16:17:43 user devstack@n-api.service[61296]: request: GET /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c HTTP/1.1 Apr 18 16:17:43 user devstack@n-api.service[61296]: Accept: application/json Apr 18 16:17:43 user devstack@n-api.service[61296]: Accept-Encoding: identity Apr 18 16:17:43 user devstack@n-api.service[61296]: Connection: close Apr 18 16:17:43 user devstack@n-api.service[61296]: Content-Length: 0 Apr 18 16:17:43 user devstack@n-api.service[61296]: Content-Type: application/json Apr 18 16:17:43 user devstack@n-api.service[61296]: Host: 10.0.0.210 Apr 18 16:17:43 user devstack@n-api.service[61296]: Openstack-System-Scope: None Apr 18 16:17:43 user devstack@n-api.service[61296]: User-Agent: python-urllib3/1.26.15 Apr 18 16:17:43 user devstack@n-api.service[61296]: X-Auth-Token: gAAAAABkPsH_Cqq9HZOiO03TqhqtHZnOGfjmePQ1THJhvZe4ZdQx-zVBilltMxYTpoL6Y7KFwoOF85yvXakSrC-qBWuklhE8x22sYuu8b_ndtZOBeFRlhk5DrbsXN380EvQAa0b43t2oi8dVbyE4KwqLYa8jdUYk0XjKqGAHBP-eyUI19AJTbw8 Apr 18 16:17:43 user devstack@n-api.service[61296]: X-Domain-Id: None Apr 18 16:17:43 user devstack@n-api.service[61296]: X-Domain-Name: None Apr 18 16:17:43 user devstack@n-api.service[61296]: X-Identity-Status: Confirmed Apr 18 16:17:43 user devstack@n-api.service[61296]: X-Is-Admin-Project: True Apr 18 16:17:43 user devstack@n-api.service[61296]: X-Project-Domain-Id: default Apr 18 16:17:43 user devstack@n-api.service[61296]: X-Project-Domain-Name: Default Apr 18 16:17:43 user devstack@n-api.service[61296]: X-Project-Id: d82a93c1cb9b4a4da7114874ddf0aa27 Apr 18 16:17:43 user devstack@n-api.service[61296]: X-Project-Name: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:17:43 user devstack@n-api.service[61296]: X-Role: reader,member Apr 18 16:17:43 user devstack@n-api.service[61296]: X-Roles: reader,member Apr 18 16:17:43 user devstack@n-api.service[61296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:17:43 user devstack@n-api.service[61296]: X-Tenant: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:17:43 user devstack@n-api.service[61296]: X-Tenant-Id: d82a93c1cb9b4a4da7114874ddf0aa27 Apr 18 16:17:43 user devstack@n-api.service[61296]: X-Tenant-Name: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:17:43 user devstack@n-api.service[61296]: X-User: tempest-AttachVolumeTestJSON-313351389-project-member Apr 18 16:17:43 user devstack@n-api.service[61296]: X-User-Domain-Id: default Apr 18 16:17:43 user devstack@n-api.service[61296]: X-User-Domain-Name: Default Apr 18 16:17:43 user devstack@n-api.service[61296]: X-User-Id: fd46686fd5b845cca0f3d9452a86f4ca Apr 18 16:17:43 user devstack@n-api.service[61296]: X-User-Name: tempest-AttachVolumeTestJSON-313351389-project-member Apr 18 16:17:43 user devstack@n-api.service[61296]: method: > Apr 18 16:17:43 user devstack@n-api.service[61296]: exception: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. Apr 18 16:17:43 user devstack@n-api.service[61296]: action_args: {'id': '8e1ccfc5-90a7-443f-83e2-c07be27d6c7c'} Apr 18 16:17:43 user devstack@n-api.service[61296]: {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. Apr 18 16:17:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:17:43 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-191f7925-cb10-47fd-9268-53a32d34f08e tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Returning 404 to user: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. {{(pid=61296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:17:43 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-191f7925-cb10-47fd-9268-53a32d34f08e tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c" status: 404 len: 111 microversion: 2.1 time: 0.030217 Apr 18 16:17:43 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 61/182] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:17:42 2023] GET /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:17:43 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-d74473b5-0610-4cc5-b134-67031f910caa tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '.version_select at 0x7fd6c9331a20>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:43 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:43 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=6 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:43 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-d74473b5-0610-4cc5-b134-67031f910caa tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312731460" status: 202 len: 0 microversion: 2.1 time: 0.045553 Apr 18 16:17:43 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 61/183] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 16:17:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312731460 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:17:43 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-d753a1e1-3372-49ae-bd4a-31465817f76c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Action: 'create', calling method: .version_select at 0x7fd6c94e24d0>, body: {"keypair": {"name": "tempest-keypair-1743850703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkq9Vg7VDQCpKpiGFoZfkEz1qZcQquI3n1H/unrAhcJuN8Zdg6SoPHia4dOkiKjV573Nr9cV3ZtHK+a5VfiLfEY5Cki6rbV4aTWzAjQWI/N4FbFpvBWX1A+Usn/9nq2QA=="}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:17:43 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-d753a1e1-3372-49ae-bd4a-31465817f76c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Getting quotas for project d82a93c1cb9b4a4da7114874ddf0aa27. Resources: {'key_pairs'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:17:43 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-d753a1e1-3372-49ae-bd4a-31465817f76c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Getting quotas for user fd46686fd5b845cca0f3d9452a86f4ca and project d82a93c1cb9b4a4da7114874ddf0aa27. Resources: {'key_pairs'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:17:43 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-d753a1e1-3372-49ae-bd4a-31465817f76c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043689 Apr 18 16:17:43 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 62/184] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 16:17:43 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2075963637", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7f49a051-667b-4e91-80de-f4bbf2d6f09e"}], "security_groups": [{"name": "tempest-securitygroup--696028719"}], "key_name": "tempest-keypair-1743850703", "user_data": "}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG nova.network.neutron [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] validate_networks() for [('7f49a051-667b-4e91-80de-f4bbf2d6f09e', None, None, None, None, None)] {{(pid=61296) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Flavor limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Image limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Flavor pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Image pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Getting quotas for project d82a93c1cb9b4a4da7114874ddf0aa27. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Getting quotas for user fd46686fd5b845cca0f3d9452a86f4ca and project d82a93c1cb9b4a4da7114874ddf0aa27. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Going to run 1 instances... {{(pid=61296) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:17:46 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: b71bd3c1-da58-4cb0-abc3-650e11b9d4ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:17:46 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-36bb0272-3ce1-4778-b58e-d527aa468220 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.661286 Apr 18 16:17:46 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 62/185] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:17:46 2023] POST /compute/v2.1/servers => generated 399 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:17:46 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-1928e897-7394-45d8-96f4-249419d640f2 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:46 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-1928e897-7394-45d8-96f4-249419d640f2 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: b71bd3c1-da58-4cb0-abc3-650e11b9d4ce] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:17:46 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-1928e897-7394-45d8-96f4-249419d640f2 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd46686fd5b845cca0f3d9452a86f4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82a93c1cb9b4a4da7114874ddf0aa27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:17:46 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-1928e897-7394-45d8-96f4-249419d640f2 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce" status: 200 len: 1232 microversion: 2.1 time: 0.109255 Apr 18 16:17:46 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 62/186] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:17:46 2023] GET /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce => generated 1232 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:17:47 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-952c5097-aa5d-4011-b1c9-11f8ddd6cb61 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Calling method '.version_select at 0x7fd6c94e3640>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:47 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-952c5097-aa5d-4011-b1c9-11f8ddd6cb61 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] 10.0.0.210 "GET /compute/v2.1/images/07d730fa-d89b-4e7e-a501-30edbfdbfe9e" status: 200 len: 1725 microversion: 2.1 time: 0.056109 Apr 18 16:17:47 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 63/187] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 16:17:47 2023] GET /compute/v2.1/images/07d730fa-d89b-4e7e-a501-30edbfdbfe9e => generated 1725 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:17:47 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-c3f59a08-9721-44b6-8e49-a2bd58b98ff6 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Calling method '.version_select at 0x7fd6c9ef6710>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:47 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-c3f59a08-9721-44b6-8e49-a2bd58b98ff6 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] 10.0.0.210 "GET /compute/v2.1/images/07d730fa-d89b-4e7e-a501-30edbfdbfe9e" status: 200 len: 1725 microversion: 2.1 time: 0.069273 Apr 18 16:17:47 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 63/188] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 16:17:47 2023] GET /compute/v2.1/images/07d730fa-d89b-4e7e-a501-30edbfdbfe9e => generated 1725 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:17:47 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-b4671239-b3b7-444b-8b43-0a3a823be6e3 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:47 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-b4671239-b3b7-444b-8b43-0a3a823be6e3 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] [instance: 8aaa4e97-9439-4760-9e05-8b248b02074f] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:17:47 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-b4671239-b3b7-444b-8b43-0a3a823be6e3 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:47 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-b4671239-b3b7-444b-8b43-0a3a823be6e3 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:47 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-b4671239-b3b7-444b-8b43-0a3a823be6e3 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:47 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-b4671239-b3b7-444b-8b43-0a3a823be6e3 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:47 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-b4671239-b3b7-444b-8b43-0a3a823be6e3 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:47 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-b4671239-b3b7-444b-8b43-0a3a823be6e3 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:47 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-b4671239-b3b7-444b-8b43-0a3a823be6e3 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a284b1ad50e463894f8d58d38a57d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fc24a9e1b646a2a08df4f53f712267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:17:47 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-b4671239-b3b7-444b-8b43-0a3a823be6e3 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f" status: 200 len: 1672 microversion: 2.1 time: 0.241657 Apr 18 16:17:47 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 63/189] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:17:47 2023] GET /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f => generated 1672 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:17:49 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-1efc91ea-fab2-4adf-8089-18be417eceb3 req-311abd58-6776-4f27-a9d4-21b0ef357abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71bd3c1-da58-4cb0-abc3-650e11b9d4ce", "tag": "4aa3a6dd-3c8a-4cb6-8fca-beb4d7988010"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:17:49 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-1efc91ea-fab2-4adf-8089-18be417eceb3 req-311abd58-6776-4f27-a9d4-21b0ef357abf service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:49 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-1efc91ea-fab2-4adf-8089-18be417eceb3 req-311abd58-6776-4f27-a9d4-21b0ef357abf service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:49 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-1efc91ea-fab2-4adf-8089-18be417eceb3 req-311abd58-6776-4f27-a9d4-21b0ef357abf service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:49 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-1efc91ea-fab2-4adf-8089-18be417eceb3 req-311abd58-6776-4f27-a9d4-21b0ef357abf service nova] Creating event network-changed:4aa3a6dd-3c8a-4cb6-8fca-beb4d7988010 for instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce on user Apr 18 16:17:49 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-1efc91ea-fab2-4adf-8089-18be417eceb3 req-311abd58-6776-4f27-a9d4-21b0ef357abf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032009 Apr 18 16:17:49 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 64/190] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:17:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:17:51 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-80126233-6659-428f-8543-d26957c4ddce tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:51 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-80126233-6659-428f-8543-d26957c4ddce tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: da82d905-1ca1-403d-9598-7561e69b9704] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:17:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-80126233-6659-428f-8543-d26957c4ddce tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-80126233-6659-428f-8543-d26957c4ddce tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-80126233-6659-428f-8543-d26957c4ddce tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-80126233-6659-428f-8543-d26957c4ddce tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-80126233-6659-428f-8543-d26957c4ddce tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-80126233-6659-428f-8543-d26957c4ddce tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:51 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-c698486d-2dbc-4853-81d4-682c661d6d49 req-1c5f45fa-f67c-4b7c-8a76-492677287c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71bd3c1-da58-4cb0-abc3-650e11b9d4ce", "name": "network-vif-plugged", "status": "completed", "tag": "4aa3a6dd-3c8a-4cb6-8fca-beb4d7988010"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:17:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-c698486d-2dbc-4853-81d4-682c661d6d49 req-1c5f45fa-f67c-4b7c-8a76-492677287c99 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-c698486d-2dbc-4853-81d4-682c661d6d49 req-1c5f45fa-f67c-4b7c-8a76-492677287c99 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-c698486d-2dbc-4853-81d4-682c661d6d49 req-1c5f45fa-f67c-4b7c-8a76-492677287c99 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:51 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-c698486d-2dbc-4853-81d4-682c661d6d49 req-1c5f45fa-f67c-4b7c-8a76-492677287c99 service nova] Creating event network-vif-plugged:4aa3a6dd-3c8a-4cb6-8fca-beb4d7988010 for instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce on user Apr 18 16:17:51 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-c698486d-2dbc-4853-81d4-682c661d6d49 req-1c5f45fa-f67c-4b7c-8a76-492677287c99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050371 Apr 18 16:17:51 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 64/191] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:17:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:17:51 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-80126233-6659-428f-8543-d26957c4ddce tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3f45f9c6c431781fb582b8da22b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261e8ba82d9e4203917afb0241a3b4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:17:51 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-80126233-6659-428f-8543-d26957c4ddce tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da82d905-1ca1-403d-9598-7561e69b9704" status: 200 len: 1505 microversion: 2.1 time: 0.256598 Apr 18 16:17:51 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 64/192] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:17:51 2023] GET /compute/v2.1/servers/da82d905-1ca1-403d-9598-7561e69b9704 => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:17:52 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-6840c71d-b218-43fa-b5c1-be2cb32b12d7 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:52 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-6840c71d-b218-43fa-b5c1-be2cb32b12d7 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:17:52 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-6840c71d-b218-43fa-b5c1-be2cb32b12d7 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:52 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-6840c71d-b218-43fa-b5c1-be2cb32b12d7 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:52 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-6840c71d-b218-43fa-b5c1-be2cb32b12d7 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:52 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-6840c71d-b218-43fa-b5c1-be2cb32b12d7 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:52 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-6840c71d-b218-43fa-b5c1-be2cb32b12d7 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:52 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-6840c71d-b218-43fa-b5c1-be2cb32b12d7 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:52 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-6840c71d-b218-43fa-b5c1-be2cb32b12d7 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b7b9d8fdcf42f29e83e755f4f27380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa61b19cc4e4cd4bb7d41291c40ef1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:17:52 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-6840c71d-b218-43fa-b5c1-be2cb32b12d7 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 200 len: 1658 microversion: 2.1 time: 0.240058 Apr 18 16:17:52 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 65/193] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:17:52 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 1658 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:17:53 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-4beb1438-51b4-4dc2-8861-2fd593acc0e1 req-dc4fd8b3-a526-4c02-bc8c-01ed9491fb42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71bd3c1-da58-4cb0-abc3-650e11b9d4ce", "name": "network-vif-plugged", "status": "completed", "tag": "4aa3a6dd-3c8a-4cb6-8fca-beb4d7988010"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:17:53 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-4beb1438-51b4-4dc2-8861-2fd593acc0e1 req-dc4fd8b3-a526-4c02-bc8c-01ed9491fb42 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:53 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-4beb1438-51b4-4dc2-8861-2fd593acc0e1 req-dc4fd8b3-a526-4c02-bc8c-01ed9491fb42 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:53 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-4beb1438-51b4-4dc2-8861-2fd593acc0e1 req-dc4fd8b3-a526-4c02-bc8c-01ed9491fb42 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:53 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-4beb1438-51b4-4dc2-8861-2fd593acc0e1 req-dc4fd8b3-a526-4c02-bc8c-01ed9491fb42 service nova] Creating event network-vif-plugged:4aa3a6dd-3c8a-4cb6-8fca-beb4d7988010 for instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce on user Apr 18 16:17:53 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-4beb1438-51b4-4dc2-8861-2fd593acc0e1 req-dc4fd8b3-a526-4c02-bc8c-01ed9491fb42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037968 Apr 18 16:17:53 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 65/194] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:17:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:17:58 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:58 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=6 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:58 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1865674245", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "networks": [{"uuid": "923d10dc-c67e-4426-9c6e-856e903e2446"}]}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:17:59 user devstack@n-api.service[61296]: DEBUG nova.network.neutron [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] validate_networks() for [('923d10dc-c67e-4426-9c6e-856e903e2446', None, None, None, None, None)] {{(pid=61296) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:17:59 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Flavor limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:17:59 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Image limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:17:59 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Flavor pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:17:59 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Image pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:17:59 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:17:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:17:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:17:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:17:59 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Getting quotas for project f516f5ec45ca4508841c77f79e8c038b. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:17:59 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Getting quotas for user c54c277689214bd0a2cadb1e2ac288a9 and project f516f5ec45ca4508841c77f79e8c038b. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:17:59 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Going to run 1 instances... {{(pid=61296) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:17:59 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6528f05a-9f05-4f35-b991-687e4f47029e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:17:59 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-af10cec7-6b35-4041-9935-8551a8bbafb8 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.663244 Apr 18 16:17:59 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 65/195] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 16:17:58 2023] POST /compute/v2.1/servers => generated 378 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 16:17:59 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-49d60e52-c416-4350-a7ec-d466f6c4d733 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:17:59 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-49d60e52-c416-4350-a7ec-d466f6c4d733 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6528f05a-9f05-4f35-b991-687e4f47029e] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:17:59 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=4 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:17:59 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-49d60e52-c416-4350-a7ec-d466f6c4d733 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:17:59 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-49d60e52-c416-4350-a7ec-d466f6c4d733 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:17:59 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-49d60e52-c416-4350-a7ec-d466f6c4d733 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:17:59 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-49d60e52-c416-4350-a7ec-d466f6c4d733 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6528f05a-9f05-4f35-b991-687e4f47029e" status: 200 len: 1395 microversion: 2.87 time: 0.075915 Apr 18 16:17:59 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 66/196] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:17:59 2023] GET /compute/v2.1/servers/6528f05a-9f05-4f35-b991-687e4f47029e => generated 1395 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:18:00 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:18:00 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-0305fc1a-2db2-40a3-bc10-7f8648e0b31d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:00 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-0305fc1a-2db2-40a3-bc10-7f8648e0b31d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0305fc1a-2db2-40a3-bc10-7f8648e0b31d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0305fc1a-2db2-40a3-bc10-7f8648e0b31d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0305fc1a-2db2-40a3-bc10-7f8648e0b31d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0305fc1a-2db2-40a3-bc10-7f8648e0b31d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0305fc1a-2db2-40a3-bc10-7f8648e0b31d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0305fc1a-2db2-40a3-bc10-7f8648e0b31d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:00 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-0305fc1a-2db2-40a3-bc10-7f8648e0b31d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af90e17ec027463fa8793e8539c39e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4e8d8797be4c0e91b1401538f2eba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:18:00 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-0305fc1a-2db2-40a3-bc10-7f8648e0b31d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc" status: 200 len: 1544 microversion: 2.1 time: 0.226860 Apr 18 16:18:00 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 66/197] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:18:00 2023] GET /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc => generated 1544 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:18:01 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-8da7c696-7ccd-4c38-9674-dba57e11e644 req-2a9894fb-8445-4efa-82b0-304000383258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6528f05a-9f05-4f35-b991-687e4f47029e", "tag": "08164ae1-ace4-4d80-ad79-1741eacfa16e"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:18:01 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-8da7c696-7ccd-4c38-9674-dba57e11e644 req-2a9894fb-8445-4efa-82b0-304000383258 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:01 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-8da7c696-7ccd-4c38-9674-dba57e11e644 req-2a9894fb-8445-4efa-82b0-304000383258 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:01 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-8da7c696-7ccd-4c38-9674-dba57e11e644 req-2a9894fb-8445-4efa-82b0-304000383258 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:01 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-8da7c696-7ccd-4c38-9674-dba57e11e644 req-2a9894fb-8445-4efa-82b0-304000383258 service nova] Creating event network-changed:08164ae1-ace4-4d80-ad79-1741eacfa16e for instance 6528f05a-9f05-4f35-b991-687e4f47029e on user Apr 18 16:18:01 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-8da7c696-7ccd-4c38-9674-dba57e11e644 req-2a9894fb-8445-4efa-82b0-304000383258 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031871 Apr 18 16:18:01 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 66/198] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:18:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:18:04 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-2928e1eb-8680-4e16-abfb-63ed00edbe5c req-72f43896-8fbb-4732-afa0-6cce6412fa29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6528f05a-9f05-4f35-b991-687e4f47029e", "name": "network-vif-plugged", "status": "completed", "tag": "08164ae1-ace4-4d80-ad79-1741eacfa16e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:18:04 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=14 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:18:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-2928e1eb-8680-4e16-abfb-63ed00edbe5c req-72f43896-8fbb-4732-afa0-6cce6412fa29 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-2928e1eb-8680-4e16-abfb-63ed00edbe5c req-72f43896-8fbb-4732-afa0-6cce6412fa29 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:04 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-2928e1eb-8680-4e16-abfb-63ed00edbe5c req-72f43896-8fbb-4732-afa0-6cce6412fa29 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:04 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-2928e1eb-8680-4e16-abfb-63ed00edbe5c req-72f43896-8fbb-4732-afa0-6cce6412fa29 service nova] Creating event network-vif-plugged:08164ae1-ace4-4d80-ad79-1741eacfa16e for instance 6528f05a-9f05-4f35-b991-687e4f47029e on user Apr 18 16:18:04 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-2928e1eb-8680-4e16-abfb-63ed00edbe5c req-72f43896-8fbb-4732-afa0-6cce6412fa29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050061 Apr 18 16:18:04 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 67/199] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:18:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:18:06 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-cda75f89-7eb7-46c2-ab25-5f0d240234f6 req-15a6278d-f3ce-4e2f-bbff-45e4c661d578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6528f05a-9f05-4f35-b991-687e4f47029e", "name": "network-vif-plugged", "status": "completed", "tag": "08164ae1-ace4-4d80-ad79-1741eacfa16e"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:18:06 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-cda75f89-7eb7-46c2-ab25-5f0d240234f6 req-15a6278d-f3ce-4e2f-bbff-45e4c661d578 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:06 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-cda75f89-7eb7-46c2-ab25-5f0d240234f6 req-15a6278d-f3ce-4e2f-bbff-45e4c661d578 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:06 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-cda75f89-7eb7-46c2-ab25-5f0d240234f6 req-15a6278d-f3ce-4e2f-bbff-45e4c661d578 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:06 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-cda75f89-7eb7-46c2-ab25-5f0d240234f6 req-15a6278d-f3ce-4e2f-bbff-45e4c661d578 service nova] Creating event network-vif-plugged:08164ae1-ace4-4d80-ad79-1741eacfa16e for instance 6528f05a-9f05-4f35-b991-687e4f47029e on user Apr 18 16:18:06 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-cda75f89-7eb7-46c2-ab25-5f0d240234f6 req-15a6278d-f3ce-4e2f-bbff-45e4c661d578 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029673 Apr 18 16:18:06 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 67/200] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:18:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:18:29 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:18:29 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=6 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:18:29 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=6 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:18:29 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=14 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:18:29 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-ad7d3288-c036-4534-831c-1ab19eedeeec tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:29 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-ad7d3288-c036-4534-831c-1ab19eedeeec tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] [instance: 0ad9c135-f279-4bd8-982d-65b45242adcf] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ad7d3288-c036-4534-831c-1ab19eedeeec tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ad7d3288-c036-4534-831c-1ab19eedeeec tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ad7d3288-c036-4534-831c-1ab19eedeeec tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ad7d3288-c036-4534-831c-1ab19eedeeec tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ad7d3288-c036-4534-831c-1ab19eedeeec tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-ad7d3288-c036-4534-831c-1ab19eedeeec tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:29 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-ad7d3288-c036-4534-831c-1ab19eedeeec tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] [instance: 0ad9c135-f279-4bd8-982d-65b45242adcf] Going to try to terminate instance {{(pid=61296) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:18:29 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-ad7d3288-c036-4534-831c-1ab19eedeeec tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0ad9c135-f279-4bd8-982d-65b45242adcf" status: 204 len: 0 microversion: 2.1 time: 0.128486 Apr 18 16:18:29 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 67/201] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:18:29 2023] DELETE /compute/v2.1/servers/0ad9c135-f279-4bd8-982d-65b45242adcf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:18:29 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:18:29 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:18:29 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:18:29 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-c3ca992c-b89c-41ce-9650-464348520c8b tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:29 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-c3ca992c-b89c-41ce-9650-464348520c8b tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] [instance: 0ad9c135-f279-4bd8-982d-65b45242adcf] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c3ca992c-b89c-41ce-9650-464348520c8b tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c3ca992c-b89c-41ce-9650-464348520c8b tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c3ca992c-b89c-41ce-9650-464348520c8b tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c3ca992c-b89c-41ce-9650-464348520c8b tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c3ca992c-b89c-41ce-9650-464348520c8b tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c3ca992c-b89c-41ce-9650-464348520c8b tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:29 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-81a1ad6a-7770-4240-a42c-3253bb953bbe req-5221d92e-54aa-45ed-83d3-5116faea9655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad9c135-f279-4bd8-982d-65b45242adcf", "name": "network-vif-unplugged", "status": "completed", "tag": "21586886-79a5-4cab-bcfe-b52b65fbf177"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:18:29 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:18:29 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=18 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:18:29 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-c3ca992c-b89c-41ce-9650-464348520c8b tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299ba2e202244f59a09e22df9ea8efe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf93a24e754e1ea58c0a7fd4f553dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:18:29 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-81a1ad6a-7770-4240-a42c-3253bb953bbe req-5221d92e-54aa-45ed-83d3-5116faea9655 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:29 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-81a1ad6a-7770-4240-a42c-3253bb953bbe req-5221d92e-54aa-45ed-83d3-5116faea9655 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:29 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-81a1ad6a-7770-4240-a42c-3253bb953bbe req-5221d92e-54aa-45ed-83d3-5116faea9655 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:29 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-c3ca992c-b89c-41ce-9650-464348520c8b tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ad9c135-f279-4bd8-982d-65b45242adcf" status: 200 len: 1500 microversion: 2.1 time: 0.265138 Apr 18 16:18:29 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 68/202] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:18:29 2023] GET /compute/v2.1/servers/0ad9c135-f279-4bd8-982d-65b45242adcf => generated 1500 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:18:29 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-81a1ad6a-7770-4240-a42c-3253bb953bbe req-5221d92e-54aa-45ed-83d3-5116faea9655 service nova] Creating event network-vif-unplugged:21586886-79a5-4cab-bcfe-b52b65fbf177 for instance 0ad9c135-f279-4bd8-982d-65b45242adcf on user Apr 18 16:18:29 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-81a1ad6a-7770-4240-a42c-3253bb953bbe req-5221d92e-54aa-45ed-83d3-5116faea9655 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046239 Apr 18 16:18:29 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 68/203] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:18:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:18:30 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-8b785bfc-a0e1-4662-8faa-ac1c2c8833f0 req-aa3731ab-41db-420d-900d-dc64e85c2068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad9c135-f279-4bd8-982d-65b45242adcf", "name": "network-vif-deleted", "tag": "21586886-79a5-4cab-bcfe-b52b65fbf177"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:18:30 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-8b785bfc-a0e1-4662-8faa-ac1c2c8833f0 req-aa3731ab-41db-420d-900d-dc64e85c2068 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:30 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-8b785bfc-a0e1-4662-8faa-ac1c2c8833f0 req-aa3731ab-41db-420d-900d-dc64e85c2068 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:30 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-8b785bfc-a0e1-4662-8faa-ac1c2c8833f0 req-aa3731ab-41db-420d-900d-dc64e85c2068 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:30 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-8b785bfc-a0e1-4662-8faa-ac1c2c8833f0 req-aa3731ab-41db-420d-900d-dc64e85c2068 service nova] Creating event network-vif-deleted:21586886-79a5-4cab-bcfe-b52b65fbf177 for instance 0ad9c135-f279-4bd8-982d-65b45242adcf on user Apr 18 16:18:30 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-8b785bfc-a0e1-4662-8faa-ac1c2c8833f0 req-aa3731ab-41db-420d-900d-dc64e85c2068 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033643 Apr 18 16:18:30 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 68/204] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:18:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:18:31 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-c31293f5-7957-4457-bf4a-f6324dddd89b req-f432a9b9-f6b6-4e3b-a739-81e2ee42067f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad9c135-f279-4bd8-982d-65b45242adcf", "name": "network-vif-plugged", "status": "completed", "tag": "21586886-79a5-4cab-bcfe-b52b65fbf177"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:18:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-c31293f5-7957-4457-bf4a-f6324dddd89b req-f432a9b9-f6b6-4e3b-a739-81e2ee42067f service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-c31293f5-7957-4457-bf4a-f6324dddd89b req-f432a9b9-f6b6-4e3b-a739-81e2ee42067f service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-c31293f5-7957-4457-bf4a-f6324dddd89b req-f432a9b9-f6b6-4e3b-a739-81e2ee42067f service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:31 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-c31293f5-7957-4457-bf4a-f6324dddd89b req-f432a9b9-f6b6-4e3b-a739-81e2ee42067f service nova] Creating event network-vif-plugged:21586886-79a5-4cab-bcfe-b52b65fbf177 for instance 0ad9c135-f279-4bd8-982d-65b45242adcf on user Apr 18 16:18:31 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-c31293f5-7957-4457-bf4a-f6324dddd89b req-f432a9b9-f6b6-4e3b-a739-81e2ee42067f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030591 Apr 18 16:18:31 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 69/205] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:18:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:18:37 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-e98828b6-a490-4c36-935e-b25acb8f1acb tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:37 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-e98828b6-a490-4c36-935e-b25acb8f1acb tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: b71bd3c1-da58-4cb0-abc3-650e11b9d4ce] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e98828b6-a490-4c36-935e-b25acb8f1acb tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e98828b6-a490-4c36-935e-b25acb8f1acb tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e98828b6-a490-4c36-935e-b25acb8f1acb tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e98828b6-a490-4c36-935e-b25acb8f1acb tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e98828b6-a490-4c36-935e-b25acb8f1acb tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e98828b6-a490-4c36-935e-b25acb8f1acb tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:37 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-e98828b6-a490-4c36-935e-b25acb8f1acb tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd46686fd5b845cca0f3d9452a86f4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82a93c1cb9b4a4da7114874ddf0aa27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:18:37 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-e98828b6-a490-4c36-935e-b25acb8f1acb tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce" status: 200 len: 1537 microversion: 2.1 time: 0.217329 Apr 18 16:18:37 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 69/206] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:18:36 2023] GET /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce => generated 1537 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:18:42 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:18:42 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:18:42 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-9a479903-ca6b-4c8c-9933-2202c3a00308 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:42 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-9a479903-ca6b-4c8c-9933-2202c3a00308 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: e32196da-a530-4422-8566-5edb01f3cc62] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-9a479903-ca6b-4c8c-9933-2202c3a00308 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-9a479903-ca6b-4c8c-9933-2202c3a00308 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-9a479903-ca6b-4c8c-9933-2202c3a00308 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-9a479903-ca6b-4c8c-9933-2202c3a00308 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-9a479903-ca6b-4c8c-9933-2202c3a00308 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-9a479903-ca6b-4c8c-9933-2202c3a00308 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:43 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-9a479903-ca6b-4c8c-9933-2202c3a00308 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.173270 Apr 18 16:18:43 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 69/207] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 18 16:18:42 2023] GET /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62/os-interface => generated 282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 16:18:43 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=4 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:18:43 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=8 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:18:43 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-d3d0e283-0d58-428c-823a-09b4f2a7250b req-0af84aa7-7dec-4f5d-a480-a6582f9f6cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32196da-a530-4422-8566-5edb01f3cc62", "tag": "203a232c-488a-427e-bf18-e99feec680b6"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:18:43 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-d3d0e283-0d58-428c-823a-09b4f2a7250b req-0af84aa7-7dec-4f5d-a480-a6582f9f6cf7 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:43 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-d3d0e283-0d58-428c-823a-09b4f2a7250b req-0af84aa7-7dec-4f5d-a480-a6582f9f6cf7 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:43 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-d3d0e283-0d58-428c-823a-09b4f2a7250b req-0af84aa7-7dec-4f5d-a480-a6582f9f6cf7 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:43 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-d3d0e283-0d58-428c-823a-09b4f2a7250b req-0af84aa7-7dec-4f5d-a480-a6582f9f6cf7 service nova] Creating event network-changed:203a232c-488a-427e-bf18-e99feec680b6 for instance e32196da-a530-4422-8566-5edb01f3cc62 on user Apr 18 16:18:43 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-d3d0e283-0d58-428c-823a-09b4f2a7250b req-0af84aa7-7dec-4f5d-a480-a6582f9f6cf7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039889 Apr 18 16:18:43 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 70/208] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:18:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:18:43 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-36b7aa15-f5a2-4ffa-b378-98454aefea49 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:43 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-36b7aa15-f5a2-4ffa-b378-98454aefea49 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: e32196da-a530-4422-8566-5edb01f3cc62] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-36b7aa15-f5a2-4ffa-b378-98454aefea49 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-36b7aa15-f5a2-4ffa-b378-98454aefea49 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-36b7aa15-f5a2-4ffa-b378-98454aefea49 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-36b7aa15-f5a2-4ffa-b378-98454aefea49 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-36b7aa15-f5a2-4ffa-b378-98454aefea49 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-36b7aa15-f5a2-4ffa-b378-98454aefea49 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:44 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-36b7aa15-f5a2-4ffa-b378-98454aefea49 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62/ips" status: 200 len: 110 microversion: 2.20 time: 0.046408 Apr 18 16:18:44 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 70/209] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 18 16:18:43 2023] GET /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62/ips => generated 110 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 16:18:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-b0ab199c-5f6f-4c4d-8aae-ff46deaa4ee6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:45 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-b0ab199c-5f6f-4c4d-8aae-ff46deaa4ee6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: e32196da-a530-4422-8566-5edb01f3cc62] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b0ab199c-5f6f-4c4d-8aae-ff46deaa4ee6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b0ab199c-5f6f-4c4d-8aae-ff46deaa4ee6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b0ab199c-5f6f-4c4d-8aae-ff46deaa4ee6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b0ab199c-5f6f-4c4d-8aae-ff46deaa4ee6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b0ab199c-5f6f-4c4d-8aae-ff46deaa4ee6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b0ab199c-5f6f-4c4d-8aae-ff46deaa4ee6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:45 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-b0ab199c-5f6f-4c4d-8aae-ff46deaa4ee6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: e32196da-a530-4422-8566-5edb01f3cc62] Going to try to terminate instance {{(pid=61296) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:18:45 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-b0ab199c-5f6f-4c4d-8aae-ff46deaa4ee6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62" status: 204 len: 0 microversion: 2.20 time: 0.115402 Apr 18 16:18:45 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 70/210] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 16:18:45 2023] DELETE /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 18 16:18:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-25e6470b-a199-4313-9bc1-21f81f58fd0b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:45 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-25e6470b-a199-4313-9bc1-21f81f58fd0b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: e32196da-a530-4422-8566-5edb01f3cc62] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:45 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-25e6470b-a199-4313-9bc1-21f81f58fd0b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:45 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-25e6470b-a199-4313-9bc1-21f81f58fd0b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:45 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-25e6470b-a199-4313-9bc1-21f81f58fd0b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:45 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-25e6470b-a199-4313-9bc1-21f81f58fd0b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:45 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-25e6470b-a199-4313-9bc1-21f81f58fd0b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:45 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-25e6470b-a199-4313-9bc1-21f81f58fd0b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-3ae5d5a6-4afe-417a-86fa-6e8f82d57e9f req-bab7f724-643c-48c5-9dd6-21fc3e5919ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32196da-a530-4422-8566-5edb01f3cc62", "name": "network-vif-unplugged", "status": "completed", "tag": "203a232c-488a-427e-bf18-e99feec680b6"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:18:45 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-3ae5d5a6-4afe-417a-86fa-6e8f82d57e9f req-bab7f724-643c-48c5-9dd6-21fc3e5919ed service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:45 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-3ae5d5a6-4afe-417a-86fa-6e8f82d57e9f req-bab7f724-643c-48c5-9dd6-21fc3e5919ed service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:45 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-3ae5d5a6-4afe-417a-86fa-6e8f82d57e9f req-bab7f724-643c-48c5-9dd6-21fc3e5919ed service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:45 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-3ae5d5a6-4afe-417a-86fa-6e8f82d57e9f req-bab7f724-643c-48c5-9dd6-21fc3e5919ed service nova] Creating event network-vif-unplugged:203a232c-488a-427e-bf18-e99feec680b6 for instance e32196da-a530-4422-8566-5edb01f3cc62 on user Apr 18 16:18:45 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-3ae5d5a6-4afe-417a-86fa-6e8f82d57e9f req-bab7f724-643c-48c5-9dd6-21fc3e5919ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029309 Apr 18 16:18:45 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 71/211] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:18:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:18:45 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-25e6470b-a199-4313-9bc1-21f81f58fd0b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:18:45 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-25e6470b-a199-4313-9bc1-21f81f58fd0b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:18:45 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-25e6470b-a199-4313-9bc1-21f81f58fd0b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:18:45 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-25e6470b-a199-4313-9bc1-21f81f58fd0b tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62" status: 200 len: 1708 microversion: 2.20 time: 0.378776 Apr 18 16:18:45 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 71/212] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:18:45 2023] GET /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62 => generated 1708 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:18:47 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-1a82560d-84b3-4a46-b59c-255501952133 req-1c684939-e8e4-4e9b-ae0a-00ce889a0b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32196da-a530-4422-8566-5edb01f3cc62", "name": "network-vif-deleted", "tag": "203a232c-488a-427e-bf18-e99feec680b6"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:18:47 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-1a82560d-84b3-4a46-b59c-255501952133 req-1c684939-e8e4-4e9b-ae0a-00ce889a0b3c service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:47 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-1a82560d-84b3-4a46-b59c-255501952133 req-1c684939-e8e4-4e9b-ae0a-00ce889a0b3c service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:47 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-1a82560d-84b3-4a46-b59c-255501952133 req-1c684939-e8e4-4e9b-ae0a-00ce889a0b3c service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:47 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-1a82560d-84b3-4a46-b59c-255501952133 req-1c684939-e8e4-4e9b-ae0a-00ce889a0b3c service nova] Creating event network-vif-deleted:203a232c-488a-427e-bf18-e99feec680b6 for instance e32196da-a530-4422-8566-5edb01f3cc62 on user Apr 18 16:18:47 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-1a82560d-84b3-4a46-b59c-255501952133 req-1c684939-e8e4-4e9b-ae0a-00ce889a0b3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037588 Apr 18 16:18:47 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 71/213] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:18:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:18:48 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-68aa021e-d05f-4c81-83cf-16da192d28af req-d7a5a978-3727-44ac-87da-e9d6d3205d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32196da-a530-4422-8566-5edb01f3cc62", "name": "network-vif-plugged", "status": "completed", "tag": "203a232c-488a-427e-bf18-e99feec680b6"}, {"server_uuid": "e32196da-a530-4422-8566-5edb01f3cc62", "name": "network-vif-plugged", "status": "completed", "tag": "203a232c-488a-427e-bf18-e99feec680b6"}, {"server_uuid": "e32196da-a530-4422-8566-5edb01f3cc62", "name": "network-vif-plugged", "status": "completed", "tag": "203a232c-488a-427e-bf18-e99feec680b6"}, {"server_uuid": "e32196da-a530-4422-8566-5edb01f3cc62", "name": "network-vif-unplugged", "status": "completed", "tag": "203a232c-488a-427e-bf18-e99feec680b6"}, {"server_uuid": "e32196da-a530-4422-8566-5edb01f3cc62", "name": "network-vif-plugged", "status": "completed", "tag": "203a232c-488a-427e-bf18-e99feec680b6"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:18:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-68aa021e-d05f-4c81-83cf-16da192d28af req-d7a5a978-3727-44ac-87da-e9d6d3205d6c service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-68aa021e-d05f-4c81-83cf-16da192d28af req-d7a5a978-3727-44ac-87da-e9d6d3205d6c service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-68aa021e-d05f-4c81-83cf-16da192d28af req-d7a5a978-3727-44ac-87da-e9d6d3205d6c service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:48 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-68aa021e-d05f-4c81-83cf-16da192d28af req-d7a5a978-3727-44ac-87da-e9d6d3205d6c service nova] Creating event network-vif-plugged:203a232c-488a-427e-bf18-e99feec680b6 for instance e32196da-a530-4422-8566-5edb01f3cc62 on user Apr 18 16:18:48 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-68aa021e-d05f-4c81-83cf-16da192d28af req-d7a5a978-3727-44ac-87da-e9d6d3205d6c service nova] Creating event network-vif-plugged:203a232c-488a-427e-bf18-e99feec680b6 for instance e32196da-a530-4422-8566-5edb01f3cc62 on user Apr 18 16:18:48 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-68aa021e-d05f-4c81-83cf-16da192d28af req-d7a5a978-3727-44ac-87da-e9d6d3205d6c service nova] Creating event network-vif-plugged:203a232c-488a-427e-bf18-e99feec680b6 for instance e32196da-a530-4422-8566-5edb01f3cc62 on user Apr 18 16:18:48 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-68aa021e-d05f-4c81-83cf-16da192d28af req-d7a5a978-3727-44ac-87da-e9d6d3205d6c service nova] Creating event network-vif-unplugged:203a232c-488a-427e-bf18-e99feec680b6 for instance e32196da-a530-4422-8566-5edb01f3cc62 on user Apr 18 16:18:48 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-68aa021e-d05f-4c81-83cf-16da192d28af req-d7a5a978-3727-44ac-87da-e9d6d3205d6c service nova] Creating event network-vif-plugged:203a232c-488a-427e-bf18-e99feec680b6 for instance e32196da-a530-4422-8566-5edb01f3cc62 on user Apr 18 16:18:48 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-68aa021e-d05f-4c81-83cf-16da192d28af req-d7a5a978-3727-44ac-87da-e9d6d3205d6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.029304 Apr 18 16:18:48 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 72/214] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:18:48 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:18:48 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-099a6b4d-699f-4e03-8f92-5b1ed77051c0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:48 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-099a6b4d-699f-4e03-8f92-5b1ed77051c0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] [instance: 8aaa4e97-9439-4760-9e05-8b248b02074f] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-099a6b4d-699f-4e03-8f92-5b1ed77051c0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-099a6b4d-699f-4e03-8f92-5b1ed77051c0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-099a6b4d-699f-4e03-8f92-5b1ed77051c0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-099a6b4d-699f-4e03-8f92-5b1ed77051c0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-099a6b4d-699f-4e03-8f92-5b1ed77051c0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-099a6b4d-699f-4e03-8f92-5b1ed77051c0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:48 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-099a6b4d-699f-4e03-8f92-5b1ed77051c0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a284b1ad50e463894f8d58d38a57d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fc24a9e1b646a2a08df4f53f712267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:18:48 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-099a6b4d-699f-4e03-8f92-5b1ed77051c0 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f" status: 200 len: 1672 microversion: 2.1 time: 0.627195 Apr 18 16:18:48 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 72/215] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:18:48 2023] GET /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f => generated 1672 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:18:49 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-3e4fd29b-65ae-47de-8451-260e823c122e tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:49 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-3e4fd29b-65ae-47de-8451-260e823c122e tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6528f05a-9f05-4f35-b991-687e4f47029e] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3e4fd29b-65ae-47de-8451-260e823c122e tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3e4fd29b-65ae-47de-8451-260e823c122e tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3e4fd29b-65ae-47de-8451-260e823c122e tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3e4fd29b-65ae-47de-8451-260e823c122e tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3e4fd29b-65ae-47de-8451-260e823c122e tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3e4fd29b-65ae-47de-8451-260e823c122e tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:49 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-3e4fd29b-65ae-47de-8451-260e823c122e tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:18:50 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-3e4fd29b-65ae-47de-8451-260e823c122e tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:18:50 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-3e4fd29b-65ae-47de-8451-260e823c122e tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:18:50 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-3e4fd29b-65ae-47de-8451-260e823c122e tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6528f05a-9f05-4f35-b991-687e4f47029e" status: 200 len: 1691 microversion: 2.87 time: 0.345376 Apr 18 16:18:50 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 72/216] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:18:49 2023] GET /compute/v2.1/servers/6528f05a-9f05-4f35-b991-687e4f47029e => generated 1691 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:18:50 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-cf4b045a-7d47-4a65-942a-143e0d7fce4d tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Calling method '.version_select at 0x7fd6c9332170>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:50 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-cf4b045a-7d47-4a65-942a-143e0d7fce4d tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/07d730fa-d89b-4e7e-a501-30edbfdbfe9e" status: 204 len: 0 microversion: 2.1 time: 0.285950 Apr 18 16:18:50 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 73/217] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:18:50 2023] DELETE /compute/v2.1/images/07d730fa-d89b-4e7e-a501-30edbfdbfe9e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:18:50 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-42975aef-8463-40b6-9b5e-5a79d07262bb tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:50 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-42975aef-8463-40b6-9b5e-5a79d07262bb tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] [instance: 8aaa4e97-9439-4760-9e05-8b248b02074f] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-42975aef-8463-40b6-9b5e-5a79d07262bb tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-42975aef-8463-40b6-9b5e-5a79d07262bb tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-42975aef-8463-40b6-9b5e-5a79d07262bb tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-42975aef-8463-40b6-9b5e-5a79d07262bb tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-42975aef-8463-40b6-9b5e-5a79d07262bb tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-42975aef-8463-40b6-9b5e-5a79d07262bb tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:50 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-42975aef-8463-40b6-9b5e-5a79d07262bb tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] [instance: 8aaa4e97-9439-4760-9e05-8b248b02074f] Going to try to terminate instance {{(pid=61294) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:18:50 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-42975aef-8463-40b6-9b5e-5a79d07262bb tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f" status: 204 len: 0 microversion: 2.1 time: 0.113639 Apr 18 16:18:50 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 73/218] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:18:50 2023] DELETE /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:18:50 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-33b6ff4d-dd67-4505-ae0f-03f14c615a7b tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:50 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-33b6ff4d-dd67-4505-ae0f-03f14c615a7b tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] [instance: 8aaa4e97-9439-4760-9e05-8b248b02074f] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-33b6ff4d-dd67-4505-ae0f-03f14c615a7b tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-33b6ff4d-dd67-4505-ae0f-03f14c615a7b tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-33b6ff4d-dd67-4505-ae0f-03f14c615a7b tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-33b6ff4d-dd67-4505-ae0f-03f14c615a7b tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-33b6ff4d-dd67-4505-ae0f-03f14c615a7b tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-33b6ff4d-dd67-4505-ae0f-03f14c615a7b tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:50 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-f07a24e1-f14b-4f98-9e28-9ae32e18264d req-af49145e-b2b4-47c8-8636-f22d15664247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aaa4e97-9439-4760-9e05-8b248b02074f", "name": "network-vif-unplugged", "status": "completed", "tag": "8029e455-c16d-48cd-93e1-cf56c226cc4a"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:18:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-f07a24e1-f14b-4f98-9e28-9ae32e18264d req-af49145e-b2b4-47c8-8636-f22d15664247 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-f07a24e1-f14b-4f98-9e28-9ae32e18264d req-af49145e-b2b4-47c8-8636-f22d15664247 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-f07a24e1-f14b-4f98-9e28-9ae32e18264d req-af49145e-b2b4-47c8-8636-f22d15664247 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:51 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-f07a24e1-f14b-4f98-9e28-9ae32e18264d req-af49145e-b2b4-47c8-8636-f22d15664247 service nova] Creating event network-vif-unplugged:8029e455-c16d-48cd-93e1-cf56c226cc4a for instance 8aaa4e97-9439-4760-9e05-8b248b02074f on user Apr 18 16:18:51 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-f07a24e1-f14b-4f98-9e28-9ae32e18264d req-af49145e-b2b4-47c8-8636-f22d15664247 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028637 Apr 18 16:18:51 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 74/219] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:18:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:18:51 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-33b6ff4d-dd67-4505-ae0f-03f14c615a7b tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a284b1ad50e463894f8d58d38a57d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6fc24a9e1b646a2a08df4f53f712267', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:18:51 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-33b6ff4d-dd67-4505-ae0f-03f14c615a7b tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f" status: 200 len: 1678 microversion: 2.1 time: 0.438995 Apr 18 16:18:51 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 73/220] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:18:50 2023] GET /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f => generated 1678 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:18:51 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-e1db0a14-d34f-4a04-a1b6-b3726470131c req-7092d2c5-ed98-4274-9f1f-b75649834842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aaa4e97-9439-4760-9e05-8b248b02074f", "name": "network-vif-deleted", "tag": "8029e455-c16d-48cd-93e1-cf56c226cc4a"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:18:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-e1db0a14-d34f-4a04-a1b6-b3726470131c req-7092d2c5-ed98-4274-9f1f-b75649834842 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-e1db0a14-d34f-4a04-a1b6-b3726470131c req-7092d2c5-ed98-4274-9f1f-b75649834842 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-e1db0a14-d34f-4a04-a1b6-b3726470131c req-7092d2c5-ed98-4274-9f1f-b75649834842 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:51 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-e1db0a14-d34f-4a04-a1b6-b3726470131c req-7092d2c5-ed98-4274-9f1f-b75649834842 service nova] Creating event network-vif-deleted:8029e455-c16d-48cd-93e1-cf56c226cc4a for instance 8aaa4e97-9439-4760-9e05-8b248b02074f on user Apr 18 16:18:51 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-e1db0a14-d34f-4a04-a1b6-b3726470131c req-7092d2c5-ed98-4274-9f1f-b75649834842 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031509 Apr 18 16:18:51 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 74/221] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:18:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 16:18:52 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-a14a6f17-29fc-49b9-9265-43d8d355b7ad tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:52 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-a14a6f17-29fc-49b9-9265-43d8d355b7ad tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-a14a6f17-29fc-49b9-9265-43d8d355b7ad tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-a14a6f17-29fc-49b9-9265-43d8d355b7ad tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-a14a6f17-29fc-49b9-9265-43d8d355b7ad tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-a14a6f17-29fc-49b9-9265-43d8d355b7ad tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-a14a6f17-29fc-49b9-9265-43d8d355b7ad tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-a14a6f17-29fc-49b9-9265-43d8d355b7ad tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:52 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-a14a6f17-29fc-49b9-9265-43d8d355b7ad tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b7b9d8fdcf42f29e83e755f4f27380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa61b19cc4e4cd4bb7d41291c40ef1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:18:52 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-a14a6f17-29fc-49b9-9265-43d8d355b7ad tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 200 len: 1658 microversion: 2.1 time: 0.282878 Apr 18 16:18:52 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 75/222] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:18:52 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 1658 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:18:52 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-6736857a-f281-4b7a-8215-41953db9c2bd tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:52 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-6736857a-f281-4b7a-8215-41953db9c2bd tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-6736857a-f281-4b7a-8215-41953db9c2bd tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-6736857a-f281-4b7a-8215-41953db9c2bd tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-6736857a-f281-4b7a-8215-41953db9c2bd tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-6736857a-f281-4b7a-8215-41953db9c2bd tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-6736857a-f281-4b7a-8215-41953db9c2bd tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:52 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-6736857a-f281-4b7a-8215-41953db9c2bd tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:53 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-03fe4dd8-7e9c-47b9-8cb4-af48fd89ba3e req-fa3cd727-5e60-4708-a7aa-ee27e4adccaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aaa4e97-9439-4760-9e05-8b248b02074f", "name": "network-vif-plugged", "status": "completed", "tag": "8029e455-c16d-48cd-93e1-cf56c226cc4a"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:18:53 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-03fe4dd8-7e9c-47b9-8cb4-af48fd89ba3e req-fa3cd727-5e60-4708-a7aa-ee27e4adccaf service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:53 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-03fe4dd8-7e9c-47b9-8cb4-af48fd89ba3e req-fa3cd727-5e60-4708-a7aa-ee27e4adccaf service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:53 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-03fe4dd8-7e9c-47b9-8cb4-af48fd89ba3e req-fa3cd727-5e60-4708-a7aa-ee27e4adccaf service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:53 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-03fe4dd8-7e9c-47b9-8cb4-af48fd89ba3e req-fa3cd727-5e60-4708-a7aa-ee27e4adccaf service nova] Creating event network-vif-plugged:8029e455-c16d-48cd-93e1-cf56c226cc4a for instance 8aaa4e97-9439-4760-9e05-8b248b02074f on user Apr 18 16:18:53 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-03fe4dd8-7e9c-47b9-8cb4-af48fd89ba3e req-fa3cd727-5e60-4708-a7aa-ee27e4adccaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033579 Apr 18 16:18:53 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 75/223] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:18:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:18:53 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-6736857a-f281-4b7a-8215-41953db9c2bd tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b7b9d8fdcf42f29e83e755f4f27380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa61b19cc4e4cd4bb7d41291c40ef1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:18:53 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-6736857a-f281-4b7a-8215-41953db9c2bd tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 200 len: 1658 microversion: 2.1 time: 0.213599 Apr 18 16:18:53 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 74/224] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:18:52 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 1658 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:18:53 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-e6362094-f511-46b4-866e-0d789551f168 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:53 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-e6362094-f511-46b4-866e-0d789551f168 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:53 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e6362094-f511-46b4-866e-0d789551f168 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:53 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e6362094-f511-46b4-866e-0d789551f168 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:53 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e6362094-f511-46b4-866e-0d789551f168 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:53 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e6362094-f511-46b4-866e-0d789551f168 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:53 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e6362094-f511-46b4-866e-0d789551f168 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:53 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e6362094-f511-46b4-866e-0d789551f168 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:53 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-e6362094-f511-46b4-866e-0d789551f168 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b7b9d8fdcf42f29e83e755f4f27380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa61b19cc4e4cd4bb7d41291c40ef1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:18:53 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-e6362094-f511-46b4-866e-0d789551f168 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 200 len: 1658 microversion: 2.1 time: 0.141923 Apr 18 16:18:53 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 76/225] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:18:53 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 1658 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:18:55 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-a4458037-ace2-4fff-bcc5-837055782440 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:55 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-a4458037-ace2-4fff-bcc5-837055782440 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: d7a293bf-a9bd-424e-ba11-bbed7dfea41c] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a4458037-ace2-4fff-bcc5-837055782440 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a4458037-ace2-4fff-bcc5-837055782440 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a4458037-ace2-4fff-bcc5-837055782440 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a4458037-ace2-4fff-bcc5-837055782440 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a4458037-ace2-4fff-bcc5-837055782440 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-a4458037-ace2-4fff-bcc5-837055782440 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:55 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-a4458037-ace2-4fff-bcc5-837055782440 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: d7a293bf-a9bd-424e-ba11-bbed7dfea41c] Going to try to terminate instance {{(pid=61294) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:18:55 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-a4458037-ace2-4fff-bcc5-837055782440 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c" status: 204 len: 0 microversion: 2.1 time: 0.120139 Apr 18 16:18:55 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 76/226] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:18:55 2023] DELETE /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:18:55 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-e6d8112f-b602-4143-b5db-84b566fde2ee tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:18:55 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-e6d8112f-b602-4143-b5db-84b566fde2ee tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: d7a293bf-a9bd-424e-ba11-bbed7dfea41c] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:18:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-e6d8112f-b602-4143-b5db-84b566fde2ee tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-e6d8112f-b602-4143-b5db-84b566fde2ee tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-e6d8112f-b602-4143-b5db-84b566fde2ee tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-e6d8112f-b602-4143-b5db-84b566fde2ee tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-e6d8112f-b602-4143-b5db-84b566fde2ee tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-e6d8112f-b602-4143-b5db-84b566fde2ee tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:55 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-1dd30b72-57f0-493d-9ff7-4a43d2ec8201 req-5f22bb7a-5526-4d68-bbec-1203d6da5778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a293bf-a9bd-424e-ba11-bbed7dfea41c", "name": "network-vif-unplugged", "status": "completed", "tag": "e5d69d5c-1a5c-4300-ab15-e73f78388f0e"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:18:55 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-1dd30b72-57f0-493d-9ff7-4a43d2ec8201 req-5f22bb7a-5526-4d68-bbec-1203d6da5778 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:55 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-1dd30b72-57f0-493d-9ff7-4a43d2ec8201 req-5f22bb7a-5526-4d68-bbec-1203d6da5778 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:55 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-1dd30b72-57f0-493d-9ff7-4a43d2ec8201 req-5f22bb7a-5526-4d68-bbec-1203d6da5778 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:55 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-e6d8112f-b602-4143-b5db-84b566fde2ee tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3f45f9c6c431781fb582b8da22b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261e8ba82d9e4203917afb0241a3b4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:18:55 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-1dd30b72-57f0-493d-9ff7-4a43d2ec8201 req-5f22bb7a-5526-4d68-bbec-1203d6da5778 service nova] Creating event network-vif-unplugged:e5d69d5c-1a5c-4300-ab15-e73f78388f0e for instance d7a293bf-a9bd-424e-ba11-bbed7dfea41c on user Apr 18 16:18:55 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-e6d8112f-b602-4143-b5db-84b566fde2ee tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c" status: 200 len: 1497 microversion: 2.1 time: 0.247123 Apr 18 16:18:55 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 75/227] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:18:55 2023] GET /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c => generated 1497 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:18:55 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-1dd30b72-57f0-493d-9ff7-4a43d2ec8201 req-5f22bb7a-5526-4d68-bbec-1203d6da5778 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032053 Apr 18 16:18:55 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 77/228] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:18:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:18:57 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-3c84ce04-9dc2-412c-9511-b5297a2cc038 req-9bd755be-c249-4bda-b244-23b52d24db09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a293bf-a9bd-424e-ba11-bbed7dfea41c", "name": "network-vif-plugged", "status": "completed", "tag": "e5d69d5c-1a5c-4300-ab15-e73f78388f0e"}, {"server_uuid": "d7a293bf-a9bd-424e-ba11-bbed7dfea41c", "name": "network-vif-deleted", "tag": "e5d69d5c-1a5c-4300-ab15-e73f78388f0e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:18:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-3c84ce04-9dc2-412c-9511-b5297a2cc038 req-9bd755be-c249-4bda-b244-23b52d24db09 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:18:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-3c84ce04-9dc2-412c-9511-b5297a2cc038 req-9bd755be-c249-4bda-b244-23b52d24db09 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:18:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-3c84ce04-9dc2-412c-9511-b5297a2cc038 req-9bd755be-c249-4bda-b244-23b52d24db09 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:18:57 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-3c84ce04-9dc2-412c-9511-b5297a2cc038 req-9bd755be-c249-4bda-b244-23b52d24db09 service nova] Creating event network-vif-plugged:e5d69d5c-1a5c-4300-ab15-e73f78388f0e for instance d7a293bf-a9bd-424e-ba11-bbed7dfea41c on user Apr 18 16:18:57 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-3c84ce04-9dc2-412c-9511-b5297a2cc038 req-9bd755be-c249-4bda-b244-23b52d24db09 service nova] Creating event network-vif-deleted:e5d69d5c-1a5c-4300-ab15-e73f78388f0e for instance d7a293bf-a9bd-424e-ba11-bbed7dfea41c on user Apr 18 16:18:57 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-3c84ce04-9dc2-412c-9511-b5297a2cc038 req-9bd755be-c249-4bda-b244-23b52d24db09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029470 Apr 18 16:18:57 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 77/229] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:18:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:00 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-4a380c0b-7bc8-4666-9193-5c3c79585676 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:00 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-4a380c0b-7bc8-4666-9193-5c3c79585676 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:00 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-4a380c0b-7bc8-4666-9193-5c3c79585676 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:00 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-4a380c0b-7bc8-4666-9193-5c3c79585676 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:00 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-4a380c0b-7bc8-4666-9193-5c3c79585676 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:00 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-4a380c0b-7bc8-4666-9193-5c3c79585676 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:00 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-4a380c0b-7bc8-4666-9193-5c3c79585676 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:00 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-4a380c0b-7bc8-4666-9193-5c3c79585676 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:01 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-4a380c0b-7bc8-4666-9193-5c3c79585676 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.745264 Apr 18 16:19:01 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 76/230] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 16:19:00 2023] GET /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc/os-interface => generated 282 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:01 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-baed56d4-a49d-45d6-904f-a367d5e9e0e3 req-b63bd555-33c4-44a0-8a06-fe8bf42d7b8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc", "tag": "bfcdfd2e-b438-4386-bcae-7088ec17c0e6"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:01 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=19 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:01 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-baed56d4-a49d-45d6-904f-a367d5e9e0e3 req-b63bd555-33c4-44a0-8a06-fe8bf42d7b8d service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:01 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-baed56d4-a49d-45d6-904f-a367d5e9e0e3 req-b63bd555-33c4-44a0-8a06-fe8bf42d7b8d service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:01 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-baed56d4-a49d-45d6-904f-a367d5e9e0e3 req-b63bd555-33c4-44a0-8a06-fe8bf42d7b8d service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:01 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=33 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:01 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-baed56d4-a49d-45d6-904f-a367d5e9e0e3 req-b63bd555-33c4-44a0-8a06-fe8bf42d7b8d service nova] Creating event network-changed:bfcdfd2e-b438-4386-bcae-7088ec17c0e6 for instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc on user Apr 18 16:19:01 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-baed56d4-a49d-45d6-904f-a367d5e9e0e3 req-b63bd555-33c4-44a0-8a06-fe8bf42d7b8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030519 Apr 18 16:19:01 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 78/231] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:19:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:01 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-2211ed58-793d-46ea-a8b0-27f63cf3db92 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:01 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-2211ed58-793d-46ea-a8b0-27f63cf3db92 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:01 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-2211ed58-793d-46ea-a8b0-27f63cf3db92 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:01 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-2211ed58-793d-46ea-a8b0-27f63cf3db92 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:01 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-2211ed58-793d-46ea-a8b0-27f63cf3db92 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:01 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-2211ed58-793d-46ea-a8b0-27f63cf3db92 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:01 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-2211ed58-793d-46ea-a8b0-27f63cf3db92 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:01 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-2211ed58-793d-46ea-a8b0-27f63cf3db92 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:01 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-2211ed58-793d-46ea-a8b0-27f63cf3db92 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc/ips" status: 200 len: 108 microversion: 2.1 time: 0.036282 Apr 18 16:19:01 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 78/232] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 16:19:01 2023] GET /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc/ips => generated 108 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:03 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-7958912e-1c48-4205-a4ee-99c51e548532 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:03 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-7958912e-1c48-4205-a4ee-99c51e548532 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:03 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7958912e-1c48-4205-a4ee-99c51e548532 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:03 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7958912e-1c48-4205-a4ee-99c51e548532 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:03 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7958912e-1c48-4205-a4ee-99c51e548532 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:03 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7958912e-1c48-4205-a4ee-99c51e548532 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:03 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7958912e-1c48-4205-a4ee-99c51e548532 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:03 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7958912e-1c48-4205-a4ee-99c51e548532 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:03 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-7958912e-1c48-4205-a4ee-99c51e548532 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc] Going to try to terminate instance {{(pid=61296) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:19:03 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-7958912e-1c48-4205-a4ee-99c51e548532 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc" status: 204 len: 0 microversion: 2.1 time: 0.124847 Apr 18 16:19:03 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 77/233] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:19:03 2023] DELETE /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:19:03 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-00bd2eb0-4bf9-4bb2-9273-239123904748 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:03 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-00bd2eb0-4bf9-4bb2-9273-239123904748 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:03 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-00bd2eb0-4bf9-4bb2-9273-239123904748 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:03 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-00bd2eb0-4bf9-4bb2-9273-239123904748 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:03 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-00bd2eb0-4bf9-4bb2-9273-239123904748 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:03 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-00bd2eb0-4bf9-4bb2-9273-239123904748 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:03 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-00bd2eb0-4bf9-4bb2-9273-239123904748 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:03 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-00bd2eb0-4bf9-4bb2-9273-239123904748 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:03 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-55839c22-a816-4f92-bd66-8a8b09bf8516 req-3d50e2c0-1969-4f8a-a9cc-4301858f3f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc", "name": "network-vif-unplugged", "status": "completed", "tag": "bfcdfd2e-b438-4386-bcae-7088ec17c0e6"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:03 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-55839c22-a816-4f92-bd66-8a8b09bf8516 req-3d50e2c0-1969-4f8a-a9cc-4301858f3f60 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:03 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-55839c22-a816-4f92-bd66-8a8b09bf8516 req-3d50e2c0-1969-4f8a-a9cc-4301858f3f60 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:03 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-55839c22-a816-4f92-bd66-8a8b09bf8516 req-3d50e2c0-1969-4f8a-a9cc-4301858f3f60 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:03 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-55839c22-a816-4f92-bd66-8a8b09bf8516 req-3d50e2c0-1969-4f8a-a9cc-4301858f3f60 service nova] Creating event network-vif-unplugged:bfcdfd2e-b438-4386-bcae-7088ec17c0e6 for instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc on user Apr 18 16:19:03 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-55839c22-a816-4f92-bd66-8a8b09bf8516 req-3d50e2c0-1969-4f8a-a9cc-4301858f3f60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029737 Apr 18 16:19:03 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 79/234] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:19:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:03 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-00bd2eb0-4bf9-4bb2-9273-239123904748 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af90e17ec027463fa8793e8539c39e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4e8d8797be4c0e91b1401538f2eba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:19:03 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-00bd2eb0-4bf9-4bb2-9273-239123904748 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc" status: 200 len: 1668 microversion: 2.1 time: 0.531063 Apr 18 16:19:03 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 79/235] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:19:03 2023] GET /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc => generated 1668 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 16:19:04 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-6fd2eaa9-c437-4d1e-90cd-46a7dd067f74 req-67faecec-faaf-4c6b-bf34-bcc89f2da162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc", "name": "network-vif-deleted", "tag": "bfcdfd2e-b438-4386-bcae-7088ec17c0e6"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:04 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-6fd2eaa9-c437-4d1e-90cd-46a7dd067f74 req-67faecec-faaf-4c6b-bf34-bcc89f2da162 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:04 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-6fd2eaa9-c437-4d1e-90cd-46a7dd067f74 req-67faecec-faaf-4c6b-bf34-bcc89f2da162 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:04 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-6fd2eaa9-c437-4d1e-90cd-46a7dd067f74 req-67faecec-faaf-4c6b-bf34-bcc89f2da162 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:04 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-6fd2eaa9-c437-4d1e-90cd-46a7dd067f74 req-67faecec-faaf-4c6b-bf34-bcc89f2da162 service nova] Creating event network-vif-deleted:bfcdfd2e-b438-4386-bcae-7088ec17c0e6 for instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc on user Apr 18 16:19:04 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-6fd2eaa9-c437-4d1e-90cd-46a7dd067f74 req-67faecec-faaf-4c6b-bf34-bcc89f2da162 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029999 Apr 18 16:19:04 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 78/236] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:19:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:05 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-4b033ef2-9578-486a-80cc-edabb29ca4e7 req-fe7e8126-9f28-4760-8dd2-e7fdeb4464e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc", "name": "network-vif-plugged", "status": "completed", "tag": "bfcdfd2e-b438-4386-bcae-7088ec17c0e6"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:05 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-4b033ef2-9578-486a-80cc-edabb29ca4e7 req-fe7e8126-9f28-4760-8dd2-e7fdeb4464e2 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:05 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-4b033ef2-9578-486a-80cc-edabb29ca4e7 req-fe7e8126-9f28-4760-8dd2-e7fdeb4464e2 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:05 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-4b033ef2-9578-486a-80cc-edabb29ca4e7 req-fe7e8126-9f28-4760-8dd2-e7fdeb4464e2 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:05 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-4b033ef2-9578-486a-80cc-edabb29ca4e7 req-fe7e8126-9f28-4760-8dd2-e7fdeb4464e2 service nova] Creating event network-vif-plugged:bfcdfd2e-b438-4386-bcae-7088ec17c0e6 for instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc on user Apr 18 16:19:05 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-4b033ef2-9578-486a-80cc-edabb29ca4e7 req-fe7e8126-9f28-4760-8dd2-e7fdeb4464e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030560 Apr 18 16:19:05 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 80/237] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:19:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:19 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-e0f7bdac-d9ff-4caf-b505-495f7df3562a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:19 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-e0f7bdac-d9ff-4caf-b505-495f7df3562a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] [instance: 0ad9c135-f279-4bd8-982d-65b45242adcf] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:19 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=3 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:19 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=7 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:19 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e0f7bdac-d9ff-4caf-b505-495f7df3562a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:19 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e0f7bdac-d9ff-4caf-b505-495f7df3562a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:19 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e0f7bdac-d9ff-4caf-b505-495f7df3562a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:19 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e0f7bdac-d9ff-4caf-b505-495f7df3562a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:19 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e0f7bdac-d9ff-4caf-b505-495f7df3562a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:19 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e0f7bdac-d9ff-4caf-b505-495f7df3562a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:19 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-e0f7bdac-d9ff-4caf-b505-495f7df3562a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] HTTP exception thrown: Instance 0ad9c135-f279-4bd8-982d-65b45242adcf could not be found. Apr 18 16:19:19 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-e0f7bdac-d9ff-4caf-b505-495f7df3562a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Request method failure captured: Apr 18 16:19:19 user devstack@n-api.service[61295]: request: GET /compute/v2.1/servers/0ad9c135-f279-4bd8-982d-65b45242adcf HTTP/1.1 Apr 18 16:19:19 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:19:19 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:19:19 user devstack@n-api.service[61295]: Connection: close Apr 18 16:19:19 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:19:19 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:19:19 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:19:19 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:19:19 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:19:19 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsHPPFcmmh-oTArhxw7uqRpztGm1S2CapFmFsdhL7HMteKED9326M1YT-OL2QDe5XSj4Rt52MXHPbuRbJ5o_PJEmoBDO0TM8xeUHstZZl2D1z6Ssb4g1vV6oMTg3uDYHc7fGcwDx7tyfXRfVxQBvA4SKMX6v4LtytmanKNXDN78YgAs Apr 18 16:19:19 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:19:19 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:19:19 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:19:19 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:19:19 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:19:19 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:19:19 user devstack@n-api.service[61295]: X-Project-Id: 8edf93a24e754e1ea58c0a7fd4f553dc Apr 18 16:19:19 user devstack@n-api.service[61295]: X-Project-Name: tempest-VolumesAdminNegativeTest-2015888259 Apr 18 16:19:19 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:19:19 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:19:19 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8edf93a24e754e1ea58c0a7fd4f553dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8edf93a24e754e1ea58c0a7fd4f553dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8edf93a24e754e1ea58c0a7fd4f553dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:19:19 user devstack@n-api.service[61295]: X-Tenant: tempest-VolumesAdminNegativeTest-2015888259 Apr 18 16:19:19 user devstack@n-api.service[61295]: X-Tenant-Id: 8edf93a24e754e1ea58c0a7fd4f553dc Apr 18 16:19:19 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2015888259 Apr 18 16:19:19 user devstack@n-api.service[61295]: X-User: tempest-VolumesAdminNegativeTest-2015888259-project-member Apr 18 16:19:19 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:19:19 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:19:19 user devstack@n-api.service[61295]: X-User-Id: 299ba2e202244f59a09e22df9ea8efe7 Apr 18 16:19:19 user devstack@n-api.service[61295]: X-User-Name: tempest-VolumesAdminNegativeTest-2015888259-project-member Apr 18 16:19:19 user devstack@n-api.service[61295]: method: > Apr 18 16:19:19 user devstack@n-api.service[61295]: exception: Instance 0ad9c135-f279-4bd8-982d-65b45242adcf could not be found. Apr 18 16:19:19 user devstack@n-api.service[61295]: action_args: {'id': '0ad9c135-f279-4bd8-982d-65b45242adcf'} Apr 18 16:19:19 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad9c135-f279-4bd8-982d-65b45242adcf could not be found. Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad9c135-f279-4bd8-982d-65b45242adcf could not be found. Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad9c135-f279-4bd8-982d-65b45242adcf could not be found. Apr 18 16:19:19 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:19:19 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-e0f7bdac-d9ff-4caf-b505-495f7df3562a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Returning 404 to user: Instance 0ad9c135-f279-4bd8-982d-65b45242adcf could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:19:19 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-e0f7bdac-d9ff-4caf-b505-495f7df3562a tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ad9c135-f279-4bd8-982d-65b45242adcf" status: 404 len: 111 microversion: 2.1 time: 0.031491 Apr 18 16:19:19 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 80/238] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:19:19 2023] GET /compute/v2.1/servers/0ad9c135-f279-4bd8-982d-65b45242adcf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:19:19 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-d3770084-766c-40ad-90d4-e8319ab3d1c8 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:19 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-d3770084-766c-40ad-90d4-e8319ab3d1c8 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] [instance: 6c592508-0444-4b42-a0b5-e3d8bd97f5ba] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:20 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:20 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:20 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d3770084-766c-40ad-90d4-e8319ab3d1c8 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:20 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d3770084-766c-40ad-90d4-e8319ab3d1c8 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:20 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d3770084-766c-40ad-90d4-e8319ab3d1c8 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:20 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d3770084-766c-40ad-90d4-e8319ab3d1c8 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:20 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d3770084-766c-40ad-90d4-e8319ab3d1c8 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:20 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d3770084-766c-40ad-90d4-e8319ab3d1c8 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:20 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-d3770084-766c-40ad-90d4-e8319ab3d1c8 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] [instance: 6c592508-0444-4b42-a0b5-e3d8bd97f5ba] Going to try to terminate instance {{(pid=61296) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:19:20 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-d3770084-766c-40ad-90d4-e8319ab3d1c8 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c592508-0444-4b42-a0b5-e3d8bd97f5ba" status: 204 len: 0 microversion: 2.1 time: 0.119002 Apr 18 16:19:20 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 79/239] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:19:19 2023] DELETE /compute/v2.1/servers/6c592508-0444-4b42-a0b5-e3d8bd97f5ba => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:19:20 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:20 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:20 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-63506313-0d30-4301-bb7b-d4770744c587 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:20 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-63506313-0d30-4301-bb7b-d4770744c587 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] [instance: 6c592508-0444-4b42-a0b5-e3d8bd97f5ba] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-63506313-0d30-4301-bb7b-d4770744c587 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-63506313-0d30-4301-bb7b-d4770744c587 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-63506313-0d30-4301-bb7b-d4770744c587 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-63506313-0d30-4301-bb7b-d4770744c587 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-63506313-0d30-4301-bb7b-d4770744c587 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-63506313-0d30-4301-bb7b-d4770744c587 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:20 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-63506313-0d30-4301-bb7b-d4770744c587 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299ba2e202244f59a09e22df9ea8efe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf93a24e754e1ea58c0a7fd4f553dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:19:20 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-63506313-0d30-4301-bb7b-d4770744c587 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c592508-0444-4b42-a0b5-e3d8bd97f5ba" status: 200 len: 1669 microversion: 2.1 time: 0.277631 Apr 18 16:19:20 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 81/240] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:19:20 2023] GET /compute/v2.1/servers/6c592508-0444-4b42-a0b5-e3d8bd97f5ba => generated 1669 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:19:20 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-8db5cd04-5ad4-414c-a7a9-b72a9e4237bc req-c6dd5208-57c0-486b-a96a-e69ee08668bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c592508-0444-4b42-a0b5-e3d8bd97f5ba", "name": "network-vif-unplugged", "status": "completed", "tag": "395afd81-e898-47ee-a928-eaab584d5b4e"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:20 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-8db5cd04-5ad4-414c-a7a9-b72a9e4237bc req-c6dd5208-57c0-486b-a96a-e69ee08668bd service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:20 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-8db5cd04-5ad4-414c-a7a9-b72a9e4237bc req-c6dd5208-57c0-486b-a96a-e69ee08668bd service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:20 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-8db5cd04-5ad4-414c-a7a9-b72a9e4237bc req-c6dd5208-57c0-486b-a96a-e69ee08668bd service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:20 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-8db5cd04-5ad4-414c-a7a9-b72a9e4237bc req-c6dd5208-57c0-486b-a96a-e69ee08668bd service nova] Creating event network-vif-unplugged:395afd81-e898-47ee-a928-eaab584d5b4e for instance 6c592508-0444-4b42-a0b5-e3d8bd97f5ba on user Apr 18 16:19:20 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-8db5cd04-5ad4-414c-a7a9-b72a9e4237bc req-c6dd5208-57c0-486b-a96a-e69ee08668bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079330 Apr 18 16:19:20 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 81/241] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:19:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:21 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-46be6c8f-ea0f-4d54-bd0c-1718f39ff622 req-2866355b-d60a-4064-8ba7-d10597d7869c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c592508-0444-4b42-a0b5-e3d8bd97f5ba", "name": "network-vif-deleted", "tag": "395afd81-e898-47ee-a928-eaab584d5b4e"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:21 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-46be6c8f-ea0f-4d54-bd0c-1718f39ff622 req-2866355b-d60a-4064-8ba7-d10597d7869c service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:21 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-46be6c8f-ea0f-4d54-bd0c-1718f39ff622 req-2866355b-d60a-4064-8ba7-d10597d7869c service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:21 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-46be6c8f-ea0f-4d54-bd0c-1718f39ff622 req-2866355b-d60a-4064-8ba7-d10597d7869c service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:21 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-46be6c8f-ea0f-4d54-bd0c-1718f39ff622 req-2866355b-d60a-4064-8ba7-d10597d7869c service nova] Creating event network-vif-deleted:395afd81-e898-47ee-a928-eaab584d5b4e for instance 6c592508-0444-4b42-a0b5-e3d8bd97f5ba on user Apr 18 16:19:21 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-46be6c8f-ea0f-4d54-bd0c-1718f39ff622 req-2866355b-d60a-4064-8ba7-d10597d7869c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112808 Apr 18 16:19:21 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 80/242] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:19:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:22 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-4697d80f-660e-488b-a1f1-902c582d6dcd req-98edf043-4549-4432-b27a-b9d5186c6278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c592508-0444-4b42-a0b5-e3d8bd97f5ba", "name": "network-vif-plugged", "status": "completed", "tag": "395afd81-e898-47ee-a928-eaab584d5b4e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:22 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-4697d80f-660e-488b-a1f1-902c582d6dcd req-98edf043-4549-4432-b27a-b9d5186c6278 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:22 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-4697d80f-660e-488b-a1f1-902c582d6dcd req-98edf043-4549-4432-b27a-b9d5186c6278 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:22 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-4697d80f-660e-488b-a1f1-902c582d6dcd req-98edf043-4549-4432-b27a-b9d5186c6278 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:22 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-4697d80f-660e-488b-a1f1-902c582d6dcd req-98edf043-4549-4432-b27a-b9d5186c6278 service nova] Creating event network-vif-plugged:395afd81-e898-47ee-a928-eaab584d5b4e for instance 6c592508-0444-4b42-a0b5-e3d8bd97f5ba on user Apr 18 16:19:22 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-4697d80f-660e-488b-a1f1-902c582d6dcd req-98edf043-4549-4432-b27a-b9d5186c6278 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028050 Apr 18 16:19:22 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 82/243] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:19:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:36 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=4 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:36 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=4 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:36 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-f6118a04-84d2-40eb-bd29-9d8032d188f2 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:36 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-f6118a04-84d2-40eb-bd29-9d8032d188f2 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: e32196da-a530-4422-8566-5edb01f3cc62] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:36 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f6118a04-84d2-40eb-bd29-9d8032d188f2 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:36 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f6118a04-84d2-40eb-bd29-9d8032d188f2 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:36 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f6118a04-84d2-40eb-bd29-9d8032d188f2 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:36 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f6118a04-84d2-40eb-bd29-9d8032d188f2 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:36 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f6118a04-84d2-40eb-bd29-9d8032d188f2 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:36 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f6118a04-84d2-40eb-bd29-9d8032d188f2 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:36 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-f6118a04-84d2-40eb-bd29-9d8032d188f2 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] HTTP exception thrown: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. Apr 18 16:19:36 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-f6118a04-84d2-40eb-bd29-9d8032d188f2 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Request method failure captured: Apr 18 16:19:36 user devstack@n-api.service[61295]: request: GET /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62 HTTP/1.1 Apr 18 16:19:36 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:19:36 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:19:36 user devstack@n-api.service[61295]: Connection: close Apr 18 16:19:36 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:19:36 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:19:36 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:19:36 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:19:36 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:19:36 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsJxZZMg8c6qOEThrY-zXDjsOBAG_RG23eHXR2U6SBC8UibggUa2pwtWgol0GRpo6F5Zpj_rEK9ckA0ydlgkbwLbbiMOJLDBmIyfRkUaFf40V_gqv58IzG4Dg3AdkiJCDUpZwqr38KjptayM9UqLuBfDqllHo9u3GkqQAbwfeOU573w Apr 18 16:19:36 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:19:36 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:19:36 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:19:36 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:19:36 user devstack@n-api.service[61295]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 16:19:36 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:19:36 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:19:36 user devstack@n-api.service[61295]: X-Project-Id: f9987eeaa6b24ca48e80e8d5318f02ac Apr 18 16:19:36 user devstack@n-api.service[61295]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:19:36 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:19:36 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:19:36 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:19:36 user devstack@n-api.service[61295]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:19:36 user devstack@n-api.service[61295]: X-Tenant-Id: f9987eeaa6b24ca48e80e8d5318f02ac Apr 18 16:19:36 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:19:36 user devstack@n-api.service[61295]: X-User: tempest-AttachVolumeShelveTestJSON-1663710151-project-member Apr 18 16:19:36 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:19:36 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:19:36 user devstack@n-api.service[61295]: X-User-Id: 73a99bbf510f4f67bb7a35901ba3edc5 Apr 18 16:19:36 user devstack@n-api.service[61295]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663710151-project-member Apr 18 16:19:36 user devstack@n-api.service[61295]: method: > Apr 18 16:19:36 user devstack@n-api.service[61295]: exception: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. Apr 18 16:19:36 user devstack@n-api.service[61295]: action_args: {'id': 'e32196da-a530-4422-8566-5edb01f3cc62'} Apr 18 16:19:36 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. Apr 18 16:19:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:19:36 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-f6118a04-84d2-40eb-bd29-9d8032d188f2 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Returning 404 to user: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:19:36 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-f6118a04-84d2-40eb-bd29-9d8032d188f2 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62" status: 404 len: 111 microversion: 2.20 time: 0.036517 Apr 18 16:19:36 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 82/244] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:19:36 2023] GET /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 16:19:36 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:36 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:36 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-5a9210e8-8952-43b5-92c0-757f860ee20d tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '.version_select at 0x7fd6c93af0a0>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:36 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-5a9210e8-8952-43b5-92c0-757f860ee20d tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-48834850" status: 204 len: 0 microversion: 2.20 time: 0.036306 Apr 18 16:19:36 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 81/245] 10.0.0.210 () {64 vars in 1333 bytes} [Tue Apr 18 16:19:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-48834850 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 16:19:36 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=4 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:36 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=8 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:36 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-04d9b4c9-177a-4727-b5a2-17bc63be11a6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Action: 'create', calling method: .version_select at 0x7fd6c94e1a20>, body: {"keypair": {"name": "tempest-keypair-1613556039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/t2zRXHckg0I8s8IBMQHTN6DHAOZW32I+dgNI9pg+HkbIaOsxkar0QwwPFIjcioaOE616z5xMRZ4Ihxh2dkemRrU9uEbk/jjZSUa1gm6kQJDS4/DyUt2ZBHtNG3kEG3g=="}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:36 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-04d9b4c9-177a-4727-b5a2-17bc63be11a6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Getting quotas for project f9987eeaa6b24ca48e80e8d5318f02ac. Resources: {'key_pairs'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:19:36 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-04d9b4c9-177a-4727-b5a2-17bc63be11a6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Getting quotas for user 73a99bbf510f4f67bb7a35901ba3edc5 and project f9987eeaa6b24ca48e80e8d5318f02ac. Resources: {'key_pairs'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:19:37 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-04d9b4c9-177a-4727-b5a2-17bc63be11a6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047702 Apr 18 16:19:37 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 83/246] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 18 16:19:36 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 18 16:19:37 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-5563cc43-ca9c-4421-803c-52b722e3e41a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:37 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-5563cc43-ca9c-4421-803c-52b722e3e41a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: b71bd3c1-da58-4cb0-abc3-650e11b9d4ce] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-5563cc43-ca9c-4421-803c-52b722e3e41a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-5563cc43-ca9c-4421-803c-52b722e3e41a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-5563cc43-ca9c-4421-803c-52b722e3e41a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-5563cc43-ca9c-4421-803c-52b722e3e41a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-5563cc43-ca9c-4421-803c-52b722e3e41a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-5563cc43-ca9c-4421-803c-52b722e3e41a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:37 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-5563cc43-ca9c-4421-803c-52b722e3e41a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.623289 Apr 18 16:19:37 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 83/247] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 16:19:37 2023] GET /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce/os-interface => generated 283 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:38 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-854e85b8-b1a6-4ce2-8e52-d6deb67ac43f req-b918a2dd-dba8-4061-bf0e-9dfb99697e29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71bd3c1-da58-4cb0-abc3-650e11b9d4ce", "tag": "4aa3a6dd-3c8a-4cb6-8fca-beb4d7988010"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:38 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-854e85b8-b1a6-4ce2-8e52-d6deb67ac43f req-b918a2dd-dba8-4061-bf0e-9dfb99697e29 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:38 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-854e85b8-b1a6-4ce2-8e52-d6deb67ac43f req-b918a2dd-dba8-4061-bf0e-9dfb99697e29 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:38 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-854e85b8-b1a6-4ce2-8e52-d6deb67ac43f req-b918a2dd-dba8-4061-bf0e-9dfb99697e29 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:38 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-854e85b8-b1a6-4ce2-8e52-d6deb67ac43f req-b918a2dd-dba8-4061-bf0e-9dfb99697e29 service nova] Creating event network-changed:4aa3a6dd-3c8a-4cb6-8fca-beb4d7988010 for instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce on user Apr 18 16:19:38 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-854e85b8-b1a6-4ce2-8e52-d6deb67ac43f req-b918a2dd-dba8-4061-bf0e-9dfb99697e29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028714 Apr 18 16:19:38 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 82/248] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:19:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:38 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-cd723940-31da-4df3-a543-dda2d39c388c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:38 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-cd723940-31da-4df3-a543-dda2d39c388c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: b71bd3c1-da58-4cb0-abc3-650e11b9d4ce] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-cd723940-31da-4df3-a543-dda2d39c388c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-cd723940-31da-4df3-a543-dda2d39c388c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-cd723940-31da-4df3-a543-dda2d39c388c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-cd723940-31da-4df3-a543-dda2d39c388c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-cd723940-31da-4df3-a543-dda2d39c388c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-cd723940-31da-4df3-a543-dda2d39c388c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:38 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-cd723940-31da-4df3-a543-dda2d39c388c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce/ips" status: 200 len: 104 microversion: 2.1 time: 0.037336 Apr 18 16:19:38 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 84/249] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 16:19:38 2023] GET /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce/ips => generated 104 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:38 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1134586344", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "51cddd0f-0e4b-4d37-be40-ce5592263bc2"}], "security_groups": [{"name": "tempest-securitygroup--681942078"}], "key_name": "tempest-keypair-1613556039", "user_data": "}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:39 user devstack@n-api.service[61295]: DEBUG nova.network.neutron [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] validate_networks() for [('51cddd0f-0e4b-4d37-be40-ce5592263bc2', None, None, None, None, None)] {{(pid=61295) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:19:39 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Flavor limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:19:39 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Image limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:19:39 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Flavor pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:19:39 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Image pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:19:39 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:19:39 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:39 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:39 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:39 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:39 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:39 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:39 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Getting quotas for project f9987eeaa6b24ca48e80e8d5318f02ac. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:19:39 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Getting quotas for user 73a99bbf510f4f67bb7a35901ba3edc5 and project f9987eeaa6b24ca48e80e8d5318f02ac. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:19:39 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Going to run 1 instances... {{(pid=61295) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:19:39 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: f5496c5f-292e-4912-991b-f834009e51a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:19:39 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-8bda2dd2-aa55-4d95-a808-696766ac749c tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.646943 Apr 18 16:19:39 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 84/250] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 16:19:38 2023] POST /compute/v2.1/servers => generated 399 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 16:19:39 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-9eec3f68-d201-4856-8c81-ecc0ea70e04a tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:39 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-9eec3f68-d201-4856-8c81-ecc0ea70e04a tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: f5496c5f-292e-4912-991b-f834009e51a1] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:39 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-9eec3f68-d201-4856-8c81-ecc0ea70e04a tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:19:39 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-9eec3f68-d201-4856-8c81-ecc0ea70e04a tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:19:39 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-9eec3f68-d201-4856-8c81-ecc0ea70e04a tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:19:39 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-9eec3f68-d201-4856-8c81-ecc0ea70e04a tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1" status: 200 len: 1276 microversion: 2.20 time: 0.065172 Apr 18 16:19:39 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 83/251] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:19:39 2023] GET /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1 => generated 1276 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:19:40 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-4e34231a-e1b7-4e65-bda5-8cab2c332fe0 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:40 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-4e34231a-e1b7-4e65-bda5-8cab2c332fe0 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: b71bd3c1-da58-4cb0-abc3-650e11b9d4ce] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:40 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-4e34231a-e1b7-4e65-bda5-8cab2c332fe0 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:40 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-4e34231a-e1b7-4e65-bda5-8cab2c332fe0 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:40 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-4e34231a-e1b7-4e65-bda5-8cab2c332fe0 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:40 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-4e34231a-e1b7-4e65-bda5-8cab2c332fe0 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:40 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-4e34231a-e1b7-4e65-bda5-8cab2c332fe0 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:40 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-4e34231a-e1b7-4e65-bda5-8cab2c332fe0 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:40 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-4e34231a-e1b7-4e65-bda5-8cab2c332fe0 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: b71bd3c1-da58-4cb0-abc3-650e11b9d4ce] Going to try to terminate instance {{(pid=61294) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:19:40 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-4e34231a-e1b7-4e65-bda5-8cab2c332fe0 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce" status: 204 len: 0 microversion: 2.1 time: 0.111698 Apr 18 16:19:40 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 85/252] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:19:40 2023] DELETE /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:19:40 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-ac27521a-6fc6-49e1-a2cf-fe6ced5b1339 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:40 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-ac27521a-6fc6-49e1-a2cf-fe6ced5b1339 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: b71bd3c1-da58-4cb0-abc3-650e11b9d4ce] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:40 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ac27521a-6fc6-49e1-a2cf-fe6ced5b1339 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:40 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ac27521a-6fc6-49e1-a2cf-fe6ced5b1339 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:40 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ac27521a-6fc6-49e1-a2cf-fe6ced5b1339 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:40 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ac27521a-6fc6-49e1-a2cf-fe6ced5b1339 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:40 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ac27521a-6fc6-49e1-a2cf-fe6ced5b1339 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:40 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ac27521a-6fc6-49e1-a2cf-fe6ced5b1339 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:40 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-ac27521a-6fc6-49e1-a2cf-fe6ced5b1339 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd46686fd5b845cca0f3d9452a86f4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82a93c1cb9b4a4da7114874ddf0aa27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:19:40 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-ac27521a-6fc6-49e1-a2cf-fe6ced5b1339 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce" status: 200 len: 1662 microversion: 2.1 time: 0.162905 Apr 18 16:19:40 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 85/253] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:19:40 2023] GET /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce => generated 1662 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:19:40 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-67772885-bc9e-4502-82f9-5a774b0e490a req-408fe818-8661-4b6c-aae6-83f1485329e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71bd3c1-da58-4cb0-abc3-650e11b9d4ce", "name": "network-vif-unplugged", "status": "completed", "tag": "4aa3a6dd-3c8a-4cb6-8fca-beb4d7988010"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:40 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-67772885-bc9e-4502-82f9-5a774b0e490a req-408fe818-8661-4b6c-aae6-83f1485329e9 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:40 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-67772885-bc9e-4502-82f9-5a774b0e490a req-408fe818-8661-4b6c-aae6-83f1485329e9 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:40 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-67772885-bc9e-4502-82f9-5a774b0e490a req-408fe818-8661-4b6c-aae6-83f1485329e9 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:40 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-67772885-bc9e-4502-82f9-5a774b0e490a req-408fe818-8661-4b6c-aae6-83f1485329e9 service nova] Creating event network-vif-unplugged:4aa3a6dd-3c8a-4cb6-8fca-beb4d7988010 for instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce on user Apr 18 16:19:40 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-67772885-bc9e-4502-82f9-5a774b0e490a req-408fe818-8661-4b6c-aae6-83f1485329e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027494 Apr 18 16:19:40 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 84/254] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:19:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:41 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-18c100a1-d4d3-41df-b169-612fefc1ce8a tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:41 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-18c100a1-d4d3-41df-b169-612fefc1ce8a tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] [instance: 8aaa4e97-9439-4760-9e05-8b248b02074f] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:41 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-18c100a1-d4d3-41df-b169-612fefc1ce8a tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:41 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-18c100a1-d4d3-41df-b169-612fefc1ce8a tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:41 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-18c100a1-d4d3-41df-b169-612fefc1ce8a tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:41 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-18c100a1-d4d3-41df-b169-612fefc1ce8a tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:41 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-18c100a1-d4d3-41df-b169-612fefc1ce8a tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:41 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-18c100a1-d4d3-41df-b169-612fefc1ce8a tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:41 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-18c100a1-d4d3-41df-b169-612fefc1ce8a tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] HTTP exception thrown: Instance 8aaa4e97-9439-4760-9e05-8b248b02074f could not be found. Apr 18 16:19:41 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-18c100a1-d4d3-41df-b169-612fefc1ce8a tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Request method failure captured: Apr 18 16:19:41 user devstack@n-api.service[61294]: request: GET /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f HTTP/1.1 Apr 18 16:19:41 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:19:41 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:19:41 user devstack@n-api.service[61294]: Connection: close Apr 18 16:19:41 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:19:41 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:19:41 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:19:41 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:19:41 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:19:41 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsIFaPExFkOxMjHA8TmsTUMhBR9BeTWtnxfiZjD4pRqbD5sDJTlSFQovZehj9CZ6X420KRwTlijZzfmbfKAh6R2garPLoU7cOcZGx2xgHVDIOK0GqzjCJ1EWKRTq5dGbqRLF22ypAw0ZRxqnwPgIkspQlaUAjMYmpkSiKJqEH3tbKQQ Apr 18 16:19:41 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:19:41 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:19:41 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:19:41 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:19:41 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:19:41 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:19:41 user devstack@n-api.service[61294]: X-Project-Id: e6fc24a9e1b646a2a08df4f53f712267 Apr 18 16:19:41 user devstack@n-api.service[61294]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1233154848 Apr 18 16:19:41 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:19:41 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:19:41 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e6fc24a9e1b646a2a08df4f53f712267"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6fc24a9e1b646a2a08df4f53f712267"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6fc24a9e1b646a2a08df4f53f712267"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:19:41 user devstack@n-api.service[61294]: X-Tenant: tempest-ServerStableDeviceRescueTest-1233154848 Apr 18 16:19:41 user devstack@n-api.service[61294]: X-Tenant-Id: e6fc24a9e1b646a2a08df4f53f712267 Apr 18 16:19:41 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1233154848 Apr 18 16:19:41 user devstack@n-api.service[61294]: X-User: tempest-ServerStableDeviceRescueTest-1233154848-project-member Apr 18 16:19:41 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:19:41 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:19:41 user devstack@n-api.service[61294]: X-User-Id: 6a284b1ad50e463894f8d58d38a57d7c Apr 18 16:19:41 user devstack@n-api.service[61294]: X-User-Name: tempest-ServerStableDeviceRescueTest-1233154848-project-member Apr 18 16:19:41 user devstack@n-api.service[61294]: method: > Apr 18 16:19:41 user devstack@n-api.service[61294]: exception: Instance 8aaa4e97-9439-4760-9e05-8b248b02074f could not be found. Apr 18 16:19:41 user devstack@n-api.service[61294]: action_args: {'id': '8aaa4e97-9439-4760-9e05-8b248b02074f'} Apr 18 16:19:41 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8aaa4e97-9439-4760-9e05-8b248b02074f could not be found. Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8aaa4e97-9439-4760-9e05-8b248b02074f could not be found. Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8aaa4e97-9439-4760-9e05-8b248b02074f could not be found. Apr 18 16:19:41 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:19:41 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-18c100a1-d4d3-41df-b169-612fefc1ce8a tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Returning 404 to user: Instance 8aaa4e97-9439-4760-9e05-8b248b02074f could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:19:41 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-18c100a1-d4d3-41df-b169-612fefc1ce8a tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f" status: 404 len: 111 microversion: 2.1 time: 0.030977 Apr 18 16:19:41 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 86/255] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:19:41 2023] GET /compute/v2.1/servers/8aaa4e97-9439-4760-9e05-8b248b02074f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:19:41 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-894b082b-2f2d-4607-bc7c-43b0af0417d2 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] Calling method '.version_select at 0x7fd6c9332560>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:41 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-894b082b-2f2d-4607-bc7c-43b0af0417d2 tempest-ServerStableDeviceRescueTest-1233154848 tempest-ServerStableDeviceRescueTest-1233154848-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985020567" status: 202 len: 0 microversion: 2.1 time: 0.020629 Apr 18 16:19:41 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 86/256] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 16:19:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985020567 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:19:41 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-62f72798-e66d-4c23-9200-033f7ff77c52 req-f358ca67-3140-41ca-9bd6-08f0f27faa16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71bd3c1-da58-4cb0-abc3-650e11b9d4ce", "name": "network-vif-deleted", "tag": "4aa3a6dd-3c8a-4cb6-8fca-beb4d7988010"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:41 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-62f72798-e66d-4c23-9200-033f7ff77c52 req-f358ca67-3140-41ca-9bd6-08f0f27faa16 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:41 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-62f72798-e66d-4c23-9200-033f7ff77c52 req-f358ca67-3140-41ca-9bd6-08f0f27faa16 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:41 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-62f72798-e66d-4c23-9200-033f7ff77c52 req-f358ca67-3140-41ca-9bd6-08f0f27faa16 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:41 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-62f72798-e66d-4c23-9200-033f7ff77c52 req-f358ca67-3140-41ca-9bd6-08f0f27faa16 service nova] Creating event network-vif-deleted:4aa3a6dd-3c8a-4cb6-8fca-beb4d7988010 for instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce on user Apr 18 16:19:41 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-62f72798-e66d-4c23-9200-033f7ff77c52 req-f358ca67-3140-41ca-9bd6-08f0f27faa16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033399 Apr 18 16:19:41 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 85/257] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:19:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:42 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-f764e83b-4914-478f-a41c-93d8513241e5 req-3fae9166-10bf-4867-93a1-6084edce1ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71bd3c1-da58-4cb0-abc3-650e11b9d4ce", "name": "network-vif-plugged", "status": "completed", "tag": "4aa3a6dd-3c8a-4cb6-8fca-beb4d7988010"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-f764e83b-4914-478f-a41c-93d8513241e5 req-3fae9166-10bf-4867-93a1-6084edce1ac0 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-f764e83b-4914-478f-a41c-93d8513241e5 req-3fae9166-10bf-4867-93a1-6084edce1ac0 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-f764e83b-4914-478f-a41c-93d8513241e5 req-3fae9166-10bf-4867-93a1-6084edce1ac0 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:42 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-f764e83b-4914-478f-a41c-93d8513241e5 req-3fae9166-10bf-4867-93a1-6084edce1ac0 service nova] Creating event network-vif-plugged:4aa3a6dd-3c8a-4cb6-8fca-beb4d7988010 for instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce on user Apr 18 16:19:42 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-f764e83b-4914-478f-a41c-93d8513241e5 req-3fae9166-10bf-4867-93a1-6084edce1ac0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031627 Apr 18 16:19:42 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 87/258] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:19:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:44 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-1119b499-48e6-4758-96ac-b5930046e93e req-4d6e6ad4-ce35-4b61-afbd-53248a8ce79d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5496c5f-292e-4912-991b-f834009e51a1", "tag": "4d7beeed-1a0b-490b-a788-3b8442f86758"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-1119b499-48e6-4758-96ac-b5930046e93e req-4d6e6ad4-ce35-4b61-afbd-53248a8ce79d service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-1119b499-48e6-4758-96ac-b5930046e93e req-4d6e6ad4-ce35-4b61-afbd-53248a8ce79d service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-1119b499-48e6-4758-96ac-b5930046e93e req-4d6e6ad4-ce35-4b61-afbd-53248a8ce79d service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:44 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-1119b499-48e6-4758-96ac-b5930046e93e req-4d6e6ad4-ce35-4b61-afbd-53248a8ce79d service nova] Creating event network-changed:4d7beeed-1a0b-490b-a788-3b8442f86758 for instance f5496c5f-292e-4912-991b-f834009e51a1 on user Apr 18 16:19:44 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-1119b499-48e6-4758-96ac-b5930046e93e req-4d6e6ad4-ce35-4b61-afbd-53248a8ce79d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031850 Apr 18 16:19:44 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 87/259] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:19:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-47e5a769-b394-4163-91c8-837b81755ed7 req-c2c094fb-d4dd-40c6-8c72-90e31bd78a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5496c5f-292e-4912-991b-f834009e51a1", "name": "network-vif-plugged", "status": "completed", "tag": "4d7beeed-1a0b-490b-a788-3b8442f86758"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-47e5a769-b394-4163-91c8-837b81755ed7 req-c2c094fb-d4dd-40c6-8c72-90e31bd78a05 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-47e5a769-b394-4163-91c8-837b81755ed7 req-c2c094fb-d4dd-40c6-8c72-90e31bd78a05 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-47e5a769-b394-4163-91c8-837b81755ed7 req-c2c094fb-d4dd-40c6-8c72-90e31bd78a05 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:45 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-47e5a769-b394-4163-91c8-837b81755ed7 req-c2c094fb-d4dd-40c6-8c72-90e31bd78a05 service nova] Creating event network-vif-plugged:4d7beeed-1a0b-490b-a788-3b8442f86758 for instance f5496c5f-292e-4912-991b-f834009e51a1 on user Apr 18 16:19:45 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-47e5a769-b394-4163-91c8-837b81755ed7 req-c2c094fb-d4dd-40c6-8c72-90e31bd78a05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027966 Apr 18 16:19:45 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 86/260] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:19:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-8e3d7fad-7559-473b-b266-08e2cf5f8c4c tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:45 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-8e3d7fad-7559-473b-b266-08e2cf5f8c4c tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: d7a293bf-a9bd-424e-ba11-bbed7dfea41c] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:45 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8e3d7fad-7559-473b-b266-08e2cf5f8c4c tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:45 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8e3d7fad-7559-473b-b266-08e2cf5f8c4c tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:45 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8e3d7fad-7559-473b-b266-08e2cf5f8c4c tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:45 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8e3d7fad-7559-473b-b266-08e2cf5f8c4c tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:45 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8e3d7fad-7559-473b-b266-08e2cf5f8c4c tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:45 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8e3d7fad-7559-473b-b266-08e2cf5f8c4c tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:45 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-8e3d7fad-7559-473b-b266-08e2cf5f8c4c tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] HTTP exception thrown: Instance d7a293bf-a9bd-424e-ba11-bbed7dfea41c could not be found. Apr 18 16:19:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-8e3d7fad-7559-473b-b266-08e2cf5f8c4c tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Request method failure captured: Apr 18 16:19:45 user devstack@n-api.service[61294]: request: GET /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c HTTP/1.1 Apr 18 16:19:45 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:19:45 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:19:45 user devstack@n-api.service[61294]: Connection: close Apr 18 16:19:45 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:19:45 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:19:45 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:19:45 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:19:45 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:19:45 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsHLexSujdbqOmIzkPAfq8iA0bip0o5ai6CR7o0XHulzA0AZglhiTE18ctCwUCvxYBrsXcLsoxBzmw3hW3Ny1RoxLwRzTuQnnsONGJJn13kFjd_NQGFV0ryMorqLrwgaLwUroimKrCH-CL9IbLN_JEgm-hYJW5nqpS0fJQwNXcKulhg Apr 18 16:19:45 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:19:45 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:19:45 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:19:45 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:19:45 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:19:45 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:19:45 user devstack@n-api.service[61294]: X-Project-Id: 261e8ba82d9e4203917afb0241a3b4fc Apr 18 16:19:45 user devstack@n-api.service[61294]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1586888284 Apr 18 16:19:45 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:19:45 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:19:45 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/261e8ba82d9e4203917afb0241a3b4fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/261e8ba82d9e4203917afb0241a3b4fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/261e8ba82d9e4203917afb0241a3b4fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:19:45 user devstack@n-api.service[61294]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1586888284 Apr 18 16:19:45 user devstack@n-api.service[61294]: X-Tenant-Id: 261e8ba82d9e4203917afb0241a3b4fc Apr 18 16:19:45 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1586888284 Apr 18 16:19:45 user devstack@n-api.service[61294]: X-User: tempest-ServerRescueNegativeTestJSON-1586888284-project-member Apr 18 16:19:45 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:19:45 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:19:45 user devstack@n-api.service[61294]: X-User-Id: a8a3f45f9c6c431781fb582b8da22b0b Apr 18 16:19:45 user devstack@n-api.service[61294]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1586888284-project-member Apr 18 16:19:45 user devstack@n-api.service[61294]: method: > Apr 18 16:19:45 user devstack@n-api.service[61294]: exception: Instance d7a293bf-a9bd-424e-ba11-bbed7dfea41c could not be found. Apr 18 16:19:45 user devstack@n-api.service[61294]: action_args: {'id': 'd7a293bf-a9bd-424e-ba11-bbed7dfea41c'} Apr 18 16:19:45 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a293bf-a9bd-424e-ba11-bbed7dfea41c could not be found. Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a293bf-a9bd-424e-ba11-bbed7dfea41c could not be found. Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a293bf-a9bd-424e-ba11-bbed7dfea41c could not be found. Apr 18 16:19:45 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:19:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-8e3d7fad-7559-473b-b266-08e2cf5f8c4c tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Returning 404 to user: Instance d7a293bf-a9bd-424e-ba11-bbed7dfea41c could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:19:45 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-8e3d7fad-7559-473b-b266-08e2cf5f8c4c tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c" status: 404 len: 111 microversion: 2.1 time: 0.175960 Apr 18 16:19:45 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 88/261] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:19:45 2023] GET /compute/v2.1/servers/d7a293bf-a9bd-424e-ba11-bbed7dfea41c => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:19:45 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-9d5ca017-8acf-477c-9870-db4667cd991f tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:45 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-9d5ca017-8acf-477c-9870-db4667cd991f tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: da82d905-1ca1-403d-9598-7561e69b9704] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:45 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-9d5ca017-8acf-477c-9870-db4667cd991f tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:45 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-9d5ca017-8acf-477c-9870-db4667cd991f tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:45 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-9d5ca017-8acf-477c-9870-db4667cd991f tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:45 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-9d5ca017-8acf-477c-9870-db4667cd991f tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:45 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-9d5ca017-8acf-477c-9870-db4667cd991f tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:45 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-9d5ca017-8acf-477c-9870-db4667cd991f tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:45 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-9d5ca017-8acf-477c-9870-db4667cd991f tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: da82d905-1ca1-403d-9598-7561e69b9704] Going to try to terminate instance {{(pid=61295) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:19:45 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-9d5ca017-8acf-477c-9870-db4667cd991f tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/da82d905-1ca1-403d-9598-7561e69b9704" status: 204 len: 0 microversion: 2.1 time: 0.118996 Apr 18 16:19:45 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 88/262] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:19:45 2023] DELETE /compute/v2.1/servers/da82d905-1ca1-403d-9598-7561e69b9704 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:19:45 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-b40dfee3-8004-4607-8ac1-435e50187500 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:45 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-b40dfee3-8004-4607-8ac1-435e50187500 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: da82d905-1ca1-403d-9598-7561e69b9704] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b40dfee3-8004-4607-8ac1-435e50187500 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b40dfee3-8004-4607-8ac1-435e50187500 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b40dfee3-8004-4607-8ac1-435e50187500 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b40dfee3-8004-4607-8ac1-435e50187500 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b40dfee3-8004-4607-8ac1-435e50187500 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:45 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b40dfee3-8004-4607-8ac1-435e50187500 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:46 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-b40dfee3-8004-4607-8ac1-435e50187500 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a3f45f9c6c431781fb582b8da22b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261e8ba82d9e4203917afb0241a3b4fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:19:46 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-b40dfee3-8004-4607-8ac1-435e50187500 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da82d905-1ca1-403d-9598-7561e69b9704" status: 200 len: 1511 microversion: 2.1 time: 0.576214 Apr 18 16:19:46 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 87/263] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:19:45 2023] GET /compute/v2.1/servers/da82d905-1ca1-403d-9598-7561e69b9704 => generated 1511 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:19:46 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-e3589629-98e2-4d4d-bd14-e5daf32133f1 req-64ebb041-5861-4221-9bc8-6c5c0732c188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da82d905-1ca1-403d-9598-7561e69b9704", "name": "network-vif-unplugged", "status": "completed", "tag": "894e80db-f051-4b32-adc8-e3afa321eb34"}, {"server_uuid": "da82d905-1ca1-403d-9598-7561e69b9704", "name": "network-vif-plugged", "status": "completed", "tag": "894e80db-f051-4b32-adc8-e3afa321eb34"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:46 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-e3589629-98e2-4d4d-bd14-e5daf32133f1 req-64ebb041-5861-4221-9bc8-6c5c0732c188 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:46 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-e3589629-98e2-4d4d-bd14-e5daf32133f1 req-64ebb041-5861-4221-9bc8-6c5c0732c188 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:46 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-e3589629-98e2-4d4d-bd14-e5daf32133f1 req-64ebb041-5861-4221-9bc8-6c5c0732c188 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:46 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-e3589629-98e2-4d4d-bd14-e5daf32133f1 req-64ebb041-5861-4221-9bc8-6c5c0732c188 service nova] Creating event network-vif-unplugged:894e80db-f051-4b32-adc8-e3afa321eb34 for instance da82d905-1ca1-403d-9598-7561e69b9704 on user Apr 18 16:19:46 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-e3589629-98e2-4d4d-bd14-e5daf32133f1 req-64ebb041-5861-4221-9bc8-6c5c0732c188 service nova] Creating event network-vif-plugged:894e80db-f051-4b32-adc8-e3afa321eb34 for instance da82d905-1ca1-403d-9598-7561e69b9704 on user Apr 18 16:19:46 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-e3589629-98e2-4d4d-bd14-e5daf32133f1 req-64ebb041-5861-4221-9bc8-6c5c0732c188 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031894 Apr 18 16:19:46 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 89/264] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:19:46 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:47 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-2188f308-e36d-4709-9fa7-6f5e31a11ceb req-e033138a-a914-496e-92ed-01349fa2d24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5496c5f-292e-4912-991b-f834009e51a1", "name": "network-vif-plugged", "status": "completed", "tag": "4d7beeed-1a0b-490b-a788-3b8442f86758"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:47 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-2188f308-e36d-4709-9fa7-6f5e31a11ceb req-e033138a-a914-496e-92ed-01349fa2d24a service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:47 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-2188f308-e36d-4709-9fa7-6f5e31a11ceb req-e033138a-a914-496e-92ed-01349fa2d24a service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:47 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-2188f308-e36d-4709-9fa7-6f5e31a11ceb req-e033138a-a914-496e-92ed-01349fa2d24a service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:47 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-2188f308-e36d-4709-9fa7-6f5e31a11ceb req-e033138a-a914-496e-92ed-01349fa2d24a service nova] Creating event network-vif-plugged:4d7beeed-1a0b-490b-a788-3b8442f86758 for instance f5496c5f-292e-4912-991b-f834009e51a1 on user Apr 18 16:19:47 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-2188f308-e36d-4709-9fa7-6f5e31a11ceb req-e033138a-a914-496e-92ed-01349fa2d24a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029421 Apr 18 16:19:47 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 89/265] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:19:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:48 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-20500898-d6f8-4bda-956b-817e0278f19f req-d4df56e8-4f5c-4d21-ba82-a2437934af2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da82d905-1ca1-403d-9598-7561e69b9704", "name": "network-vif-deleted", "tag": "894e80db-f051-4b32-adc8-e3afa321eb34"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-20500898-d6f8-4bda-956b-817e0278f19f req-d4df56e8-4f5c-4d21-ba82-a2437934af2e service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-20500898-d6f8-4bda-956b-817e0278f19f req-d4df56e8-4f5c-4d21-ba82-a2437934af2e service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-20500898-d6f8-4bda-956b-817e0278f19f req-d4df56e8-4f5c-4d21-ba82-a2437934af2e service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:48 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-20500898-d6f8-4bda-956b-817e0278f19f req-d4df56e8-4f5c-4d21-ba82-a2437934af2e service nova] Creating event network-vif-deleted:894e80db-f051-4b32-adc8-e3afa321eb34 for instance da82d905-1ca1-403d-9598-7561e69b9704 on user Apr 18 16:19:48 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-20500898-d6f8-4bda-956b-817e0278f19f req-d4df56e8-4f5c-4d21-ba82-a2437934af2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032100 Apr 18 16:19:48 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 88/266] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:19:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:50 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-3db2d662-4f4d-4e06-9a1c-20a769ee95b7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1025324730"}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:50 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-3db2d662-4f4d-4e06-9a1c-20a769ee95b7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6528f05a-9f05-4f35-b991-687e4f47029e] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:50 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=4 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-3db2d662-4f4d-4e06-9a1c-20a769ee95b7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-3db2d662-4f4d-4e06-9a1c-20a769ee95b7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-3db2d662-4f4d-4e06-9a1c-20a769ee95b7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-3db2d662-4f4d-4e06-9a1c-20a769ee95b7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-3db2d662-4f4d-4e06-9a1c-20a769ee95b7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-3db2d662-4f4d-4e06-9a1c-20a769ee95b7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:50 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-3db2d662-4f4d-4e06-9a1c-20a769ee95b7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6528f05a-9f05-4f35-b991-687e4f47029e/action" status: 202 len: 52 microversion: 2.87 time: 0.826998 Apr 18 16:19:50 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 90/267] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 18 16:19:50 2023] POST /compute/v2.1/servers/6528f05a-9f05-4f35-b991-687e4f47029e/action => generated 52 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 18 16:19:53 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:53 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=6 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:54 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-5db621e6-a423-4f43-bc29-cb634b708ea3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:54 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-5db621e6-a423-4f43-bc29-cb634b708ea3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:54 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-5db621e6-a423-4f43-bc29-cb634b708ea3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:54 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-5db621e6-a423-4f43-bc29-cb634b708ea3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:54 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-5db621e6-a423-4f43-bc29-cb634b708ea3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:54 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-5db621e6-a423-4f43-bc29-cb634b708ea3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:54 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-5db621e6-a423-4f43-bc29-cb634b708ea3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:54 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-5db621e6-a423-4f43-bc29-cb634b708ea3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:54 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-5db621e6-a423-4f43-bc29-cb634b708ea3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] HTTP exception thrown: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. Apr 18 16:19:54 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-5db621e6-a423-4f43-bc29-cb634b708ea3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Request method failure captured: Apr 18 16:19:54 user devstack@n-api.service[61295]: request: GET /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc HTTP/1.1 Apr 18 16:19:54 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:19:54 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:19:54 user devstack@n-api.service[61295]: Connection: close Apr 18 16:19:54 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:19:54 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:19:54 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:19:54 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:19:54 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:19:54 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsHTZ7piGp01Yhd4R65i1j6b1tm_mMC4UdZnSeVxAUqrjcgOgLCuqXk0nrLp3WWbo5cJrYSMAj1QaNQisCM4wiIgBJFWpK96pq4PU3dacvENZhQvIWTlb95XqutwUJW_QMqFtqglLPmnY7p8o40n_yxwAZ-6Her-cOHvYNFFN0lubNw Apr 18 16:19:54 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:19:54 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:19:54 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:19:54 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:19:54 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:19:54 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:19:54 user devstack@n-api.service[61295]: X-Project-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:19:54 user devstack@n-api.service[61295]: X-Project-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:19:54 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:19:54 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:19:54 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:19:54 user devstack@n-api.service[61295]: X-Tenant: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:19:54 user devstack@n-api.service[61295]: X-Tenant-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:19:54 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:19:54 user devstack@n-api.service[61295]: X-User: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:19:54 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:19:54 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:19:54 user devstack@n-api.service[61295]: X-User-Id: af90e17ec027463fa8793e8539c39e13 Apr 18 16:19:54 user devstack@n-api.service[61295]: X-User-Name: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:19:54 user devstack@n-api.service[61295]: method: > Apr 18 16:19:54 user devstack@n-api.service[61295]: exception: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. Apr 18 16:19:54 user devstack@n-api.service[61295]: action_args: {'id': 'f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc'} Apr 18 16:19:54 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. Apr 18 16:19:54 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:19:54 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-5db621e6-a423-4f43-bc29-cb634b708ea3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Returning 404 to user: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:19:54 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-5db621e6-a423-4f43-bc29-cb634b708ea3 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc" status: 404 len: 111 microversion: 2.1 time: 0.206743 Apr 18 16:19:54 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 90/268] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:19:53 2023] GET /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:19:54 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:19:54 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-a19207f2-7567-4d99-acce-4a83ef5e82bb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '.version_select at 0x7fd6c955f370>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:54 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-a19207f2-7567-4d99-acce-4a83ef5e82bb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1742241088" status: 202 len: 0 microversion: 2.1 time: 0.027319 Apr 18 16:19:54 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 89/269] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 16:19:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1742241088 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:19:54 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-7d88ea6e-1d22-44a1-9188-10ebd5245b85 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:54 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-7d88ea6e-1d22-44a1-9188-10ebd5245b85 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:54 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-7d88ea6e-1d22-44a1-9188-10ebd5245b85 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:54 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-7d88ea6e-1d22-44a1-9188-10ebd5245b85 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:54 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-7d88ea6e-1d22-44a1-9188-10ebd5245b85 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:54 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-7d88ea6e-1d22-44a1-9188-10ebd5245b85 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:54 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-7d88ea6e-1d22-44a1-9188-10ebd5245b85 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:54 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-7d88ea6e-1d22-44a1-9188-10ebd5245b85 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:54 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-f1698066-5ef3-41de-9258-87c4d4f52615 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Action: 'create', calling method: .version_select at 0x7fd6c9331d80>, body: {"keypair": {"name": "tempest-keypair-901960884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYRXU/ibSPY+lfyweoe12uOrvfmUvG6DlTq9LgRSH5Mu+rZpmKAfw8UVQNbDlibCQU69kF6sfr+Z42hzsCh/sT3mzfLZiHHLTZ94at32kiiHcYOGoL6apTKhxzZMUuP2A=="}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:54 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-f1698066-5ef3-41de-9258-87c4d4f52615 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Getting quotas for project 6b4e8d8797be4c0e91b1401538f2eba8. Resources: {'key_pairs'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:19:54 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-f1698066-5ef3-41de-9258-87c4d4f52615 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Getting quotas for user af90e17ec027463fa8793e8539c39e13 and project 6b4e8d8797be4c0e91b1401538f2eba8. Resources: {'key_pairs'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:19:55 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-f1698066-5ef3-41de-9258-87c4d4f52615 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053223 Apr 18 16:19:55 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 91/270] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 16:19:54 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:19:55 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-7d88ea6e-1d22-44a1-9188-10ebd5245b85 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b7b9d8fdcf42f29e83e755f4f27380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa61b19cc4e4cd4bb7d41291c40ef1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:19:55 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-7d88ea6e-1d22-44a1-9188-10ebd5245b85 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 200 len: 1658 microversion: 2.1 time: 0.285244 Apr 18 16:19:55 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 91/271] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:19:54 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 1658 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:19:56 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2112657845", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "02aca424-2923-404b-9c66-76bec89f82b7"}], "security_groups": [{"name": "tempest-securitygroup--14429997"}], "key_name": "tempest-keypair-901960884", "user_data": "}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:19:56 user devstack@n-api.service[61296]: DEBUG nova.network.neutron [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] validate_networks() for [('02aca424-2923-404b-9c66-76bec89f82b7', None, None, None, None, None)] {{(pid=61296) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:19:57 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-404a1bec-a0ce-4c07-9a61-6dda43977952 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:57 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-404a1bec-a0ce-4c07-9a61-6dda43977952 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6528f05a-9f05-4f35-b991-687e4f47029e] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:57 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-404a1bec-a0ce-4c07-9a61-6dda43977952 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:57 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-404a1bec-a0ce-4c07-9a61-6dda43977952 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:57 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-404a1bec-a0ce-4c07-9a61-6dda43977952 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:57 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-404a1bec-a0ce-4c07-9a61-6dda43977952 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:57 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-404a1bec-a0ce-4c07-9a61-6dda43977952 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:57 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-404a1bec-a0ce-4c07-9a61-6dda43977952 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:57 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-404a1bec-a0ce-4c07-9a61-6dda43977952 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:19:57 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-404a1bec-a0ce-4c07-9a61-6dda43977952 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:19:57 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-404a1bec-a0ce-4c07-9a61-6dda43977952 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:19:57 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-404a1bec-a0ce-4c07-9a61-6dda43977952 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6528f05a-9f05-4f35-b991-687e4f47029e" status: 200 len: 1691 microversion: 2.87 time: 0.346487 Apr 18 16:19:57 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 92/272] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:19:57 2023] GET /compute/v2.1/servers/6528f05a-9f05-4f35-b991-687e4f47029e => generated 1691 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:19:57 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Flavor limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:19:57 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Image limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:19:57 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Flavor pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:19:57 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Image pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:19:57 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:19:57 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:57 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:57 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:57 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:19:57 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:19:57 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:19:57 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Getting quotas for project 6b4e8d8797be4c0e91b1401538f2eba8. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:19:57 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Getting quotas for user af90e17ec027463fa8793e8539c39e13 and project 6b4e8d8797be4c0e91b1401538f2eba8. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:19:57 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Going to run 1 instances... {{(pid=61296) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:19:57 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f6d6085d-9e15-4e29-ab90-3a8928971324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:19:57 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-01e86ce5-2b6e-4db5-9dd3-c08b693ca307 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.1 time: 1.166393 Apr 18 16:19:57 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 90/273] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:19:56 2023] POST /compute/v2.1/servers => generated 398 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:19:57 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-c1c8c2ec-dc61-44c8-bfc3-07d55cd86016 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:19:57 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-c1c8c2ec-dc61-44c8-bfc3-07d55cd86016 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f6d6085d-9e15-4e29-ab90-3a8928971324] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:19:58 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-c1c8c2ec-dc61-44c8-bfc3-07d55cd86016 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af90e17ec027463fa8793e8539c39e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4e8d8797be4c0e91b1401538f2eba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:19:58 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-c1c8c2ec-dc61-44c8-bfc3-07d55cd86016 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324" status: 200 len: 1235 microversion: 2.1 time: 0.064544 Apr 18 16:19:58 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 92/274] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:19:57 2023] GET /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324 => generated 1235 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:20:02 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-e4b8e942-ddf5-47f5-a496-9dd3deae5bf3 req-8cf5a286-1a9d-4581-801a-f8d73e412c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6d6085d-9e15-4e29-ab90-3a8928971324", "tag": "fb818849-31a0-4c25-b42d-ca19fe250ca6"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:02 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-e4b8e942-ddf5-47f5-a496-9dd3deae5bf3 req-8cf5a286-1a9d-4581-801a-f8d73e412c80 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:02 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-e4b8e942-ddf5-47f5-a496-9dd3deae5bf3 req-8cf5a286-1a9d-4581-801a-f8d73e412c80 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:02 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-e4b8e942-ddf5-47f5-a496-9dd3deae5bf3 req-8cf5a286-1a9d-4581-801a-f8d73e412c80 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:02 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-e4b8e942-ddf5-47f5-a496-9dd3deae5bf3 req-8cf5a286-1a9d-4581-801a-f8d73e412c80 service nova] Creating event network-changed:fb818849-31a0-4c25-b42d-ca19fe250ca6 for instance f6d6085d-9e15-4e29-ab90-3a8928971324 on user Apr 18 16:20:02 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-e4b8e942-ddf5-47f5-a496-9dd3deae5bf3 req-8cf5a286-1a9d-4581-801a-f8d73e412c80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028366 Apr 18 16:20:02 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 93/275] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:20:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:20:04 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-4efa3f06-f7d7-426b-bdc0-0a99c2ef6de6 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Action: 'create', calling method: .version_select at 0x7fd6c955f5b0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-898730089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjB7c1t/30/n9+kA02kID4xCptJhD3sPRt7RADFNBND5ODgA1T9Tp0ttLsMngsvRYW4lRZy7x7r7VmJz6i3Dd8HWEtRffPcfiU0xC7owaaIepRkCkRUzrPyKKptrcjx0A=="}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:04 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-4efa3f06-f7d7-426b-bdc0-0a99c2ef6de6 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Getting quotas for project 000fb9c948224fe3b595882d36cfb859. Resources: {'key_pairs'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:20:04 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-4efa3f06-f7d7-426b-bdc0-0a99c2ef6de6 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Getting quotas for user b01da22d0c8c4ee580567646e279d7b9 and project 000fb9c948224fe3b595882d36cfb859. Resources: {'key_pairs'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:20:04 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-4efa3f06-f7d7-426b-bdc0-0a99c2ef6de6 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.239220 Apr 18 16:20:04 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 91/276] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 16:20:04 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:20:05 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:05 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-4b230ccc-ec38-4621-a32c-90f199d9cf9a req-7bef9ee3-547c-47ce-9117-7fa348a6320b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d6085d-9e15-4e29-ab90-3a8928971324", "name": "network-vif-plugged", "status": "completed", "tag": "fb818849-31a0-4c25-b42d-ca19fe250ca6"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:05 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-4b230ccc-ec38-4621-a32c-90f199d9cf9a req-7bef9ee3-547c-47ce-9117-7fa348a6320b service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:05 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-4b230ccc-ec38-4621-a32c-90f199d9cf9a req-7bef9ee3-547c-47ce-9117-7fa348a6320b service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:05 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-4b230ccc-ec38-4621-a32c-90f199d9cf9a req-7bef9ee3-547c-47ce-9117-7fa348a6320b service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:05 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-4b230ccc-ec38-4621-a32c-90f199d9cf9a req-7bef9ee3-547c-47ce-9117-7fa348a6320b service nova] Creating event network-vif-plugged:fb818849-31a0-4c25-b42d-ca19fe250ca6 for instance f6d6085d-9e15-4e29-ab90-3a8928971324 on user Apr 18 16:20:05 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-4b230ccc-ec38-4621-a32c-90f199d9cf9a req-7bef9ee3-547c-47ce-9117-7fa348a6320b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100703 Apr 18 16:20:05 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 93/277] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:20:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:20:05 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=4 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:05 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-751902854", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-898730089", "security_groups": [{"name": "tempest-secgroup-smoke-895756791"}], "networks": [{"uuid": "c17e54e4-8788-475c-b342-65dddd71342f"}]}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG nova.network.neutron [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] validate_networks() for [('c17e54e4-8788-475c-b342-65dddd71342f', None, None, None, None, None)] {{(pid=61295) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Flavor limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Image limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Flavor pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Image pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Getting quotas for project 000fb9c948224fe3b595882d36cfb859. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Getting quotas for user b01da22d0c8c4ee580567646e279d7b9 and project 000fb9c948224fe3b595882d36cfb859. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Going to run 1 instances... {{(pid=61295) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:20:06 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] [instance: 5f4e6f9b-5413-4399-83ca-9bc78911db38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:20:06 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-d693e0ca-58b5-43b5-90ed-a15fd0c0cf0f tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.610083 Apr 18 16:20:06 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 94/278] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:20:05 2023] POST /compute/v2.1/servers => generated 403 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:20:06 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-a81b6b9e-f616-48ac-acdf-04aecf1f2476 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:06 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-a81b6b9e-f616-48ac-acdf-04aecf1f2476 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] [instance: 5f4e6f9b-5413-4399-83ca-9bc78911db38] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:06 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:06 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-a81b6b9e-f616-48ac-acdf-04aecf1f2476 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01da22d0c8c4ee580567646e279d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '000fb9c948224fe3b595882d36cfb859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:20:06 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-a81b6b9e-f616-48ac-acdf-04aecf1f2476 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f4e6f9b-5413-4399-83ca-9bc78911db38" status: 200 len: 1255 microversion: 2.1 time: 0.064293 Apr 18 16:20:06 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 92/279] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:20:06 2023] GET /compute/v2.1/servers/5f4e6f9b-5413-4399-83ca-9bc78911db38 => generated 1255 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:20:07 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-5f2ff3e4-4e6c-45dc-a6c3-94bd4c561904 req-6e90d571-6bd5-4077-9e08-646433ef41fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d6085d-9e15-4e29-ab90-3a8928971324", "name": "network-vif-plugged", "status": "completed", "tag": "fb818849-31a0-4c25-b42d-ca19fe250ca6"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:07 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:07 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-5f2ff3e4-4e6c-45dc-a6c3-94bd4c561904 req-6e90d571-6bd5-4077-9e08-646433ef41fb service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:07 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-5f2ff3e4-4e6c-45dc-a6c3-94bd4c561904 req-6e90d571-6bd5-4077-9e08-646433ef41fb service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:07 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-5f2ff3e4-4e6c-45dc-a6c3-94bd4c561904 req-6e90d571-6bd5-4077-9e08-646433ef41fb service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:07 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-5f2ff3e4-4e6c-45dc-a6c3-94bd4c561904 req-6e90d571-6bd5-4077-9e08-646433ef41fb service nova] Creating event network-vif-plugged:fb818849-31a0-4c25-b42d-ca19fe250ca6 for instance f6d6085d-9e15-4e29-ab90-3a8928971324 on user Apr 18 16:20:07 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-5f2ff3e4-4e6c-45dc-a6c3-94bd4c561904 req-6e90d571-6bd5-4077-9e08-646433ef41fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030210 Apr 18 16:20:07 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 94/280] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:20:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:20:08 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-6cdbf5de-6b5a-4167-8801-73edc86728dc req-257c65fd-02aa-4bab-b67f-eac619dd4e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f4e6f9b-5413-4399-83ca-9bc78911db38", "tag": "4330b5f4-c990-4a7d-aa5f-f95315fddf78"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:08 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-6cdbf5de-6b5a-4167-8801-73edc86728dc req-257c65fd-02aa-4bab-b67f-eac619dd4e01 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:08 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-6cdbf5de-6b5a-4167-8801-73edc86728dc req-257c65fd-02aa-4bab-b67f-eac619dd4e01 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:08 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-6cdbf5de-6b5a-4167-8801-73edc86728dc req-257c65fd-02aa-4bab-b67f-eac619dd4e01 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:08 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-6cdbf5de-6b5a-4167-8801-73edc86728dc req-257c65fd-02aa-4bab-b67f-eac619dd4e01 service nova] Creating event network-changed:4330b5f4-c990-4a7d-aa5f-f95315fddf78 for instance 5f4e6f9b-5413-4399-83ca-9bc78911db38 on user Apr 18 16:20:08 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-6cdbf5de-6b5a-4167-8801-73edc86728dc req-257c65fd-02aa-4bab-b67f-eac619dd4e01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030757 Apr 18 16:20:08 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 95/281] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:20:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:20:10 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:10 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=18 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:10 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-8e90d558-369f-4095-a77b-e5ce92259cce tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:10 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-8e90d558-369f-4095-a77b-e5ce92259cce tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] [instance: 6c592508-0444-4b42-a0b5-e3d8bd97f5ba] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:10 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-8e90d558-369f-4095-a77b-e5ce92259cce tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:10 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-8e90d558-369f-4095-a77b-e5ce92259cce tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:10 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-8e90d558-369f-4095-a77b-e5ce92259cce tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:10 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-8e90d558-369f-4095-a77b-e5ce92259cce tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:10 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-8e90d558-369f-4095-a77b-e5ce92259cce tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:10 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-8e90d558-369f-4095-a77b-e5ce92259cce tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:10 user devstack@n-api.service[61296]: INFO nova.api.openstack.wsgi [None req-8e90d558-369f-4095-a77b-e5ce92259cce tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] HTTP exception thrown: Instance 6c592508-0444-4b42-a0b5-e3d8bd97f5ba could not be found. Apr 18 16:20:10 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-8e90d558-369f-4095-a77b-e5ce92259cce tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Request method failure captured: Apr 18 16:20:10 user devstack@n-api.service[61296]: request: GET /compute/v2.1/servers/6c592508-0444-4b42-a0b5-e3d8bd97f5ba HTTP/1.1 Apr 18 16:20:10 user devstack@n-api.service[61296]: Accept: application/json Apr 18 16:20:10 user devstack@n-api.service[61296]: Accept-Encoding: identity Apr 18 16:20:10 user devstack@n-api.service[61296]: Connection: close Apr 18 16:20:10 user devstack@n-api.service[61296]: Content-Length: 0 Apr 18 16:20:10 user devstack@n-api.service[61296]: Content-Type: application/json Apr 18 16:20:10 user devstack@n-api.service[61296]: Host: 10.0.0.210 Apr 18 16:20:10 user devstack@n-api.service[61296]: Openstack-System-Scope: None Apr 18 16:20:10 user devstack@n-api.service[61296]: User-Agent: python-urllib3/1.26.15 Apr 18 16:20:10 user devstack@n-api.service[61296]: X-Auth-Token: gAAAAABkPsHPPFcmmh-oTArhxw7uqRpztGm1S2CapFmFsdhL7HMteKED9326M1YT-OL2QDe5XSj4Rt52MXHPbuRbJ5o_PJEmoBDO0TM8xeUHstZZl2D1z6Ssb4g1vV6oMTg3uDYHc7fGcwDx7tyfXRfVxQBvA4SKMX6v4LtytmanKNXDN78YgAs Apr 18 16:20:10 user devstack@n-api.service[61296]: X-Domain-Id: None Apr 18 16:20:10 user devstack@n-api.service[61296]: X-Domain-Name: None Apr 18 16:20:10 user devstack@n-api.service[61296]: X-Identity-Status: Confirmed Apr 18 16:20:10 user devstack@n-api.service[61296]: X-Is-Admin-Project: True Apr 18 16:20:10 user devstack@n-api.service[61296]: X-Project-Domain-Id: default Apr 18 16:20:10 user devstack@n-api.service[61296]: X-Project-Domain-Name: Default Apr 18 16:20:10 user devstack@n-api.service[61296]: X-Project-Id: 8edf93a24e754e1ea58c0a7fd4f553dc Apr 18 16:20:10 user devstack@n-api.service[61296]: X-Project-Name: tempest-VolumesAdminNegativeTest-2015888259 Apr 18 16:20:10 user devstack@n-api.service[61296]: X-Role: reader,member Apr 18 16:20:10 user devstack@n-api.service[61296]: X-Roles: reader,member Apr 18 16:20:10 user devstack@n-api.service[61296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8edf93a24e754e1ea58c0a7fd4f553dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8edf93a24e754e1ea58c0a7fd4f553dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8edf93a24e754e1ea58c0a7fd4f553dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:20:10 user devstack@n-api.service[61296]: X-Tenant: tempest-VolumesAdminNegativeTest-2015888259 Apr 18 16:20:10 user devstack@n-api.service[61296]: X-Tenant-Id: 8edf93a24e754e1ea58c0a7fd4f553dc Apr 18 16:20:10 user devstack@n-api.service[61296]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2015888259 Apr 18 16:20:10 user devstack@n-api.service[61296]: X-User: tempest-VolumesAdminNegativeTest-2015888259-project-member Apr 18 16:20:10 user devstack@n-api.service[61296]: X-User-Domain-Id: default Apr 18 16:20:10 user devstack@n-api.service[61296]: X-User-Domain-Name: Default Apr 18 16:20:10 user devstack@n-api.service[61296]: X-User-Id: 299ba2e202244f59a09e22df9ea8efe7 Apr 18 16:20:10 user devstack@n-api.service[61296]: X-User-Name: tempest-VolumesAdminNegativeTest-2015888259-project-member Apr 18 16:20:10 user devstack@n-api.service[61296]: method: > Apr 18 16:20:10 user devstack@n-api.service[61296]: exception: Instance 6c592508-0444-4b42-a0b5-e3d8bd97f5ba could not be found. Apr 18 16:20:10 user devstack@n-api.service[61296]: action_args: {'id': '6c592508-0444-4b42-a0b5-e3d8bd97f5ba'} Apr 18 16:20:10 user devstack@n-api.service[61296]: {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c592508-0444-4b42-a0b5-e3d8bd97f5ba could not be found. Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c592508-0444-4b42-a0b5-e3d8bd97f5ba could not be found. Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c592508-0444-4b42-a0b5-e3d8bd97f5ba could not be found. Apr 18 16:20:10 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:20:10 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-8e90d558-369f-4095-a77b-e5ce92259cce tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Returning 404 to user: Instance 6c592508-0444-4b42-a0b5-e3d8bd97f5ba could not be found. {{(pid=61296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:20:10 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-8e90d558-369f-4095-a77b-e5ce92259cce tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c592508-0444-4b42-a0b5-e3d8bd97f5ba" status: 404 len: 111 microversion: 2.1 time: 0.132426 Apr 18 16:20:10 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 93/282] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:20:10 2023] GET /compute/v2.1/servers/6c592508-0444-4b42-a0b5-e3d8bd97f5ba => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:20:10 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:10 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-491ddeac-c257-4689-85e8-424b39f26035 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] Calling method '.version_select at 0x7fd6c94e1d80>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:10 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-491ddeac-c257-4689-85e8-424b39f26035 tempest-VolumesAdminNegativeTest-2015888259 tempest-VolumesAdminNegativeTest-2015888259-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1220171208" status: 202 len: 0 microversion: 2.1 time: 0.025793 Apr 18 16:20:10 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 95/283] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 16:20:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1220171208 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:20:11 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-93049643-9c0c-491a-93bb-88c022f122c6 req-6dd305a5-a413-4f01-8b69-8e2055a1a2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f4e6f9b-5413-4399-83ca-9bc78911db38", "name": "network-vif-plugged", "status": "completed", "tag": "4330b5f4-c990-4a7d-aa5f-f95315fddf78"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:11 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-93049643-9c0c-491a-93bb-88c022f122c6 req-6dd305a5-a413-4f01-8b69-8e2055a1a2c1 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:11 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-93049643-9c0c-491a-93bb-88c022f122c6 req-6dd305a5-a413-4f01-8b69-8e2055a1a2c1 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:11 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-93049643-9c0c-491a-93bb-88c022f122c6 req-6dd305a5-a413-4f01-8b69-8e2055a1a2c1 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:11 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-93049643-9c0c-491a-93bb-88c022f122c6 req-6dd305a5-a413-4f01-8b69-8e2055a1a2c1 service nova] Creating event network-vif-plugged:4330b5f4-c990-4a7d-aa5f-f95315fddf78 for instance 5f4e6f9b-5413-4399-83ca-9bc78911db38 on user Apr 18 16:20:11 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-93049643-9c0c-491a-93bb-88c022f122c6 req-6dd305a5-a413-4f01-8b69-8e2055a1a2c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031906 Apr 18 16:20:11 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 96/284] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:20:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:20:13 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-13235056-56e9-4221-89f1-7ac3f1e53f28 req-55c0cd1b-eb38-4ee0-b33e-413e1ff75caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f4e6f9b-5413-4399-83ca-9bc78911db38", "name": "network-vif-plugged", "status": "completed", "tag": "4330b5f4-c990-4a7d-aa5f-f95315fddf78"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:13 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-13235056-56e9-4221-89f1-7ac3f1e53f28 req-55c0cd1b-eb38-4ee0-b33e-413e1ff75caa service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:13 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-13235056-56e9-4221-89f1-7ac3f1e53f28 req-55c0cd1b-eb38-4ee0-b33e-413e1ff75caa service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:13 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-13235056-56e9-4221-89f1-7ac3f1e53f28 req-55c0cd1b-eb38-4ee0-b33e-413e1ff75caa service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:13 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-13235056-56e9-4221-89f1-7ac3f1e53f28 req-55c0cd1b-eb38-4ee0-b33e-413e1ff75caa service nova] Creating event network-vif-plugged:4330b5f4-c990-4a7d-aa5f-f95315fddf78 for instance 5f4e6f9b-5413-4399-83ca-9bc78911db38 on user Apr 18 16:20:13 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-13235056-56e9-4221-89f1-7ac3f1e53f28 req-55c0cd1b-eb38-4ee0-b33e-413e1ff75caa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031215 Apr 18 16:20:13 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 94/285] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:20:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:20:29 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=4 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:29 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:29 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-68d1efd3-8fbc-4398-8e78-f30829fa8337 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:29 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-68d1efd3-8fbc-4398-8e78-f30829fa8337 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: f5496c5f-292e-4912-991b-f834009e51a1] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-68d1efd3-8fbc-4398-8e78-f30829fa8337 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-68d1efd3-8fbc-4398-8e78-f30829fa8337 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-68d1efd3-8fbc-4398-8e78-f30829fa8337 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-68d1efd3-8fbc-4398-8e78-f30829fa8337 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-68d1efd3-8fbc-4398-8e78-f30829fa8337 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-68d1efd3-8fbc-4398-8e78-f30829fa8337 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:29 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-68d1efd3-8fbc-4398-8e78-f30829fa8337 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:20:29 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-68d1efd3-8fbc-4398-8e78-f30829fa8337 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:20:29 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-68d1efd3-8fbc-4398-8e78-f30829fa8337 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:20:29 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-68d1efd3-8fbc-4398-8e78-f30829fa8337 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1" status: 200 len: 1587 microversion: 2.20 time: 0.231916 Apr 18 16:20:29 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 96/286] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:20:29 2023] GET /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1 => generated 1587 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:20:30 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:30 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=6 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:30 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=3 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:30 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=5 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:30 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-cfaee16f-52d6-4414-8401-6e78a43fc15c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:30 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-cfaee16f-52d6-4414-8401-6e78a43fc15c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: b71bd3c1-da58-4cb0-abc3-650e11b9d4ce] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-cfaee16f-52d6-4414-8401-6e78a43fc15c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-cfaee16f-52d6-4414-8401-6e78a43fc15c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-cfaee16f-52d6-4414-8401-6e78a43fc15c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-cfaee16f-52d6-4414-8401-6e78a43fc15c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-cfaee16f-52d6-4414-8401-6e78a43fc15c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-cfaee16f-52d6-4414-8401-6e78a43fc15c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:30 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-cfaee16f-52d6-4414-8401-6e78a43fc15c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] HTTP exception thrown: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. Apr 18 16:20:30 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-cfaee16f-52d6-4414-8401-6e78a43fc15c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Request method failure captured: Apr 18 16:20:30 user devstack@n-api.service[61295]: request: GET /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce HTTP/1.1 Apr 18 16:20:30 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:20:30 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:20:30 user devstack@n-api.service[61295]: Connection: close Apr 18 16:20:30 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:20:30 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:20:30 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:20:30 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:20:30 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:20:30 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsH_Cqq9HZOiO03TqhqtHZnOGfjmePQ1THJhvZe4ZdQx-zVBilltMxYTpoL6Y7KFwoOF85yvXakSrC-qBWuklhE8x22sYuu8b_ndtZOBeFRlhk5DrbsXN380EvQAa0b43t2oi8dVbyE4KwqLYa8jdUYk0XjKqGAHBP-eyUI19AJTbw8 Apr 18 16:20:30 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:20:30 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:20:30 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:20:30 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:20:30 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:20:30 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:20:30 user devstack@n-api.service[61295]: X-Project-Id: d82a93c1cb9b4a4da7114874ddf0aa27 Apr 18 16:20:30 user devstack@n-api.service[61295]: X-Project-Name: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:20:30 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:20:30 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:20:30 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:20:30 user devstack@n-api.service[61295]: X-Tenant: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:20:30 user devstack@n-api.service[61295]: X-Tenant-Id: d82a93c1cb9b4a4da7114874ddf0aa27 Apr 18 16:20:30 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:20:30 user devstack@n-api.service[61295]: X-User: tempest-AttachVolumeTestJSON-313351389-project-member Apr 18 16:20:30 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:20:30 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:20:30 user devstack@n-api.service[61295]: X-User-Id: fd46686fd5b845cca0f3d9452a86f4ca Apr 18 16:20:30 user devstack@n-api.service[61295]: X-User-Name: tempest-AttachVolumeTestJSON-313351389-project-member Apr 18 16:20:30 user devstack@n-api.service[61295]: method: > Apr 18 16:20:30 user devstack@n-api.service[61295]: exception: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. Apr 18 16:20:30 user devstack@n-api.service[61295]: action_args: {'id': 'b71bd3c1-da58-4cb0-abc3-650e11b9d4ce'} Apr 18 16:20:30 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. Apr 18 16:20:30 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:20:30 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-cfaee16f-52d6-4414-8401-6e78a43fc15c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Returning 404 to user: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:20:30 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-cfaee16f-52d6-4414-8401-6e78a43fc15c tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce" status: 404 len: 111 microversion: 2.1 time: 0.188617 Apr 18 16:20:30 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 97/287] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:20:30 2023] GET /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:20:30 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-5c06826c-752b-4727-b9d2-164df82252c6 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '.version_select at 0x7fd6c93af520>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:30 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=12 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:30 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=7 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:30 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=4 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:30 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-5c06826c-752b-4727-b9d2-164df82252c6 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1743850703" status: 202 len: 0 microversion: 2.1 time: 0.028189 Apr 18 16:20:30 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 95/288] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 16:20:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1743850703 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-ad9c0cf7-a0d9-40f0-9907-b4157a6f103f tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-ad9c0cf7-a0d9-40f0-9907-b4157a6f103f tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: b71bd3c1-da58-4cb0-abc3-650e11b9d4ce] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ad9c0cf7-a0d9-40f0-9907-b4157a6f103f tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ad9c0cf7-a0d9-40f0-9907-b4157a6f103f tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ad9c0cf7-a0d9-40f0-9907-b4157a6f103f tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ad9c0cf7-a0d9-40f0-9907-b4157a6f103f tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ad9c0cf7-a0d9-40f0-9907-b4157a6f103f tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ad9c0cf7-a0d9-40f0-9907-b4157a6f103f tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:31 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-ad9c0cf7-a0d9-40f0-9907-b4157a6f103f tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] HTTP exception thrown: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-ad9c0cf7-a0d9-40f0-9907-b4157a6f103f tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Request method failure captured: Apr 18 16:20:31 user devstack@n-api.service[61294]: request: DELETE /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce HTTP/1.1 Apr 18 16:20:31 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:20:31 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:20:31 user devstack@n-api.service[61294]: Connection: close Apr 18 16:20:31 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:20:31 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:20:31 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:20:31 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:20:31 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsH_Cqq9HZOiO03TqhqtHZnOGfjmePQ1THJhvZe4ZdQx-zVBilltMxYTpoL6Y7KFwoOF85yvXakSrC-qBWuklhE8x22sYuu8b_ndtZOBeFRlhk5DrbsXN380EvQAa0b43t2oi8dVbyE4KwqLYa8jdUYk0XjKqGAHBP-eyUI19AJTbw8 Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Project-Id: d82a93c1cb9b4a4da7114874ddf0aa27 Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Project-Name: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Tenant: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Tenant-Id: d82a93c1cb9b4a4da7114874ddf0aa27 Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:20:31 user devstack@n-api.service[61294]: X-User: tempest-AttachVolumeTestJSON-313351389-project-member Apr 18 16:20:31 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:20:31 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:20:31 user devstack@n-api.service[61294]: X-User-Id: fd46686fd5b845cca0f3d9452a86f4ca Apr 18 16:20:31 user devstack@n-api.service[61294]: X-User-Name: tempest-AttachVolumeTestJSON-313351389-project-member Apr 18 16:20:31 user devstack@n-api.service[61294]: method: > Apr 18 16:20:31 user devstack@n-api.service[61294]: exception: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. Apr 18 16:20:31 user devstack@n-api.service[61294]: action_args: {'id': 'b71bd3c1-da58-4cb0-abc3-650e11b9d4ce'} Apr 18 16:20:31 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-ad9c0cf7-a0d9-40f0-9907-b4157a6f103f tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Returning 404 to user: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:20:31 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-ad9c0cf7-a0d9-40f0-9907-b4157a6f103f tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce" status: 404 len: 111 microversion: 2.1 time: 0.038570 Apr 18 16:20:31 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 97/289] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:20:31 2023] DELETE /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:20:31 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-a702daca-c489-421d-82c4-6b9c4539160a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:31 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-a702daca-c489-421d-82c4-6b9c4539160a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: b71bd3c1-da58-4cb0-abc3-650e11b9d4ce] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:31 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-a702daca-c489-421d-82c4-6b9c4539160a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:31 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-a702daca-c489-421d-82c4-6b9c4539160a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:31 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-a702daca-c489-421d-82c4-6b9c4539160a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:31 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-a702daca-c489-421d-82c4-6b9c4539160a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:31 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-a702daca-c489-421d-82c4-6b9c4539160a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:31 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-a702daca-c489-421d-82c4-6b9c4539160a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:31 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-a702daca-c489-421d-82c4-6b9c4539160a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] HTTP exception thrown: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. Apr 18 16:20:31 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-a702daca-c489-421d-82c4-6b9c4539160a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Request method failure captured: Apr 18 16:20:31 user devstack@n-api.service[61295]: request: GET /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce HTTP/1.1 Apr 18 16:20:31 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:20:31 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:20:31 user devstack@n-api.service[61295]: Connection: close Apr 18 16:20:31 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:20:31 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:20:31 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:20:31 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:20:31 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:20:31 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsH_Cqq9HZOiO03TqhqtHZnOGfjmePQ1THJhvZe4ZdQx-zVBilltMxYTpoL6Y7KFwoOF85yvXakSrC-qBWuklhE8x22sYuu8b_ndtZOBeFRlhk5DrbsXN380EvQAa0b43t2oi8dVbyE4KwqLYa8jdUYk0XjKqGAHBP-eyUI19AJTbw8 Apr 18 16:20:31 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:20:31 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:20:31 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:20:31 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:20:31 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:20:31 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:20:31 user devstack@n-api.service[61295]: X-Project-Id: d82a93c1cb9b4a4da7114874ddf0aa27 Apr 18 16:20:31 user devstack@n-api.service[61295]: X-Project-Name: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:20:31 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:20:31 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:20:31 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:20:31 user devstack@n-api.service[61295]: X-Tenant: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:20:31 user devstack@n-api.service[61295]: X-Tenant-Id: d82a93c1cb9b4a4da7114874ddf0aa27 Apr 18 16:20:31 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:20:31 user devstack@n-api.service[61295]: X-User: tempest-AttachVolumeTestJSON-313351389-project-member Apr 18 16:20:31 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:20:31 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:20:31 user devstack@n-api.service[61295]: X-User-Id: fd46686fd5b845cca0f3d9452a86f4ca Apr 18 16:20:31 user devstack@n-api.service[61295]: X-User-Name: tempest-AttachVolumeTestJSON-313351389-project-member Apr 18 16:20:31 user devstack@n-api.service[61295]: method: > Apr 18 16:20:31 user devstack@n-api.service[61295]: exception: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. Apr 18 16:20:31 user devstack@n-api.service[61295]: action_args: {'id': 'b71bd3c1-da58-4cb0-abc3-650e11b9d4ce'} Apr 18 16:20:31 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. Apr 18 16:20:31 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-a702daca-c489-421d-82c4-6b9c4539160a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Returning 404 to user: Instance b71bd3c1-da58-4cb0-abc3-650e11b9d4ce could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:20:31 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-a702daca-c489-421d-82c4-6b9c4539160a tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce" status: 404 len: 111 microversion: 2.1 time: 0.032060 Apr 18 16:20:31 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 98/290] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:20:31 2023] GET /compute/v2.1/servers/b71bd3c1-da58-4cb0-abc3-650e11b9d4ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:20:31 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-870ea94e-e265-4c90-be76-e1d3c8f2b478 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:31 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-870ea94e-e265-4c90-be76-e1d3c8f2b478 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:31 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-870ea94e-e265-4c90-be76-e1d3c8f2b478 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:31 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-870ea94e-e265-4c90-be76-e1d3c8f2b478 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:31 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-870ea94e-e265-4c90-be76-e1d3c8f2b478 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:31 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-870ea94e-e265-4c90-be76-e1d3c8f2b478 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:31 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-870ea94e-e265-4c90-be76-e1d3c8f2b478 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:31 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-870ea94e-e265-4c90-be76-e1d3c8f2b478 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:31 user devstack@n-api.service[61296]: INFO nova.api.openstack.wsgi [None req-870ea94e-e265-4c90-be76-e1d3c8f2b478 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] HTTP exception thrown: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. Apr 18 16:20:31 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-870ea94e-e265-4c90-be76-e1d3c8f2b478 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Request method failure captured: Apr 18 16:20:31 user devstack@n-api.service[61296]: request: DELETE /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c HTTP/1.1 Apr 18 16:20:31 user devstack@n-api.service[61296]: Accept: application/json Apr 18 16:20:31 user devstack@n-api.service[61296]: Accept-Encoding: identity Apr 18 16:20:31 user devstack@n-api.service[61296]: Connection: close Apr 18 16:20:31 user devstack@n-api.service[61296]: Content-Length: 0 Apr 18 16:20:31 user devstack@n-api.service[61296]: Content-Type: application/json Apr 18 16:20:31 user devstack@n-api.service[61296]: Host: 10.0.0.210 Apr 18 16:20:31 user devstack@n-api.service[61296]: Openstack-System-Scope: None Apr 18 16:20:31 user devstack@n-api.service[61296]: User-Agent: python-urllib3/1.26.15 Apr 18 16:20:31 user devstack@n-api.service[61296]: X-Auth-Token: gAAAAABkPsH_Cqq9HZOiO03TqhqtHZnOGfjmePQ1THJhvZe4ZdQx-zVBilltMxYTpoL6Y7KFwoOF85yvXakSrC-qBWuklhE8x22sYuu8b_ndtZOBeFRlhk5DrbsXN380EvQAa0b43t2oi8dVbyE4KwqLYa8jdUYk0XjKqGAHBP-eyUI19AJTbw8 Apr 18 16:20:31 user devstack@n-api.service[61296]: X-Domain-Id: None Apr 18 16:20:31 user devstack@n-api.service[61296]: X-Domain-Name: None Apr 18 16:20:31 user devstack@n-api.service[61296]: X-Identity-Status: Confirmed Apr 18 16:20:31 user devstack@n-api.service[61296]: X-Is-Admin-Project: True Apr 18 16:20:31 user devstack@n-api.service[61296]: X-Project-Domain-Id: default Apr 18 16:20:31 user devstack@n-api.service[61296]: X-Project-Domain-Name: Default Apr 18 16:20:31 user devstack@n-api.service[61296]: X-Project-Id: d82a93c1cb9b4a4da7114874ddf0aa27 Apr 18 16:20:31 user devstack@n-api.service[61296]: X-Project-Name: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:20:31 user devstack@n-api.service[61296]: X-Role: reader,member Apr 18 16:20:31 user devstack@n-api.service[61296]: X-Roles: reader,member Apr 18 16:20:31 user devstack@n-api.service[61296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:20:31 user devstack@n-api.service[61296]: X-Tenant: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:20:31 user devstack@n-api.service[61296]: X-Tenant-Id: d82a93c1cb9b4a4da7114874ddf0aa27 Apr 18 16:20:31 user devstack@n-api.service[61296]: X-Tenant-Name: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:20:31 user devstack@n-api.service[61296]: X-User: tempest-AttachVolumeTestJSON-313351389-project-member Apr 18 16:20:31 user devstack@n-api.service[61296]: X-User-Domain-Id: default Apr 18 16:20:31 user devstack@n-api.service[61296]: X-User-Domain-Name: Default Apr 18 16:20:31 user devstack@n-api.service[61296]: X-User-Id: fd46686fd5b845cca0f3d9452a86f4ca Apr 18 16:20:31 user devstack@n-api.service[61296]: X-User-Name: tempest-AttachVolumeTestJSON-313351389-project-member Apr 18 16:20:31 user devstack@n-api.service[61296]: method: > Apr 18 16:20:31 user devstack@n-api.service[61296]: exception: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. Apr 18 16:20:31 user devstack@n-api.service[61296]: action_args: {'id': '8e1ccfc5-90a7-443f-83e2-c07be27d6c7c'} Apr 18 16:20:31 user devstack@n-api.service[61296]: {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. Apr 18 16:20:31 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-870ea94e-e265-4c90-be76-e1d3c8f2b478 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Returning 404 to user: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. {{(pid=61296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:20:31 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-870ea94e-e265-4c90-be76-e1d3c8f2b478 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c" status: 404 len: 111 microversion: 2.1 time: 0.027034 Apr 18 16:20:31 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 96/291] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:20:31 2023] DELETE /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-d9969fe1-b0f6-42c8-bb4a-d1b9b7255dd4 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-d9969fe1-b0f6-42c8-bb4a-d1b9b7255dd4 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] [instance: 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-d9969fe1-b0f6-42c8-bb4a-d1b9b7255dd4 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-d9969fe1-b0f6-42c8-bb4a-d1b9b7255dd4 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-d9969fe1-b0f6-42c8-bb4a-d1b9b7255dd4 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-d9969fe1-b0f6-42c8-bb4a-d1b9b7255dd4 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-d9969fe1-b0f6-42c8-bb4a-d1b9b7255dd4 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-d9969fe1-b0f6-42c8-bb4a-d1b9b7255dd4 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:31 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-d9969fe1-b0f6-42c8-bb4a-d1b9b7255dd4 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] HTTP exception thrown: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-d9969fe1-b0f6-42c8-bb4a-d1b9b7255dd4 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Request method failure captured: Apr 18 16:20:31 user devstack@n-api.service[61294]: request: GET /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c HTTP/1.1 Apr 18 16:20:31 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:20:31 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:20:31 user devstack@n-api.service[61294]: Connection: close Apr 18 16:20:31 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:20:31 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:20:31 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:20:31 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:20:31 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsH_Cqq9HZOiO03TqhqtHZnOGfjmePQ1THJhvZe4ZdQx-zVBilltMxYTpoL6Y7KFwoOF85yvXakSrC-qBWuklhE8x22sYuu8b_ndtZOBeFRlhk5DrbsXN380EvQAa0b43t2oi8dVbyE4KwqLYa8jdUYk0XjKqGAHBP-eyUI19AJTbw8 Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Project-Id: d82a93c1cb9b4a4da7114874ddf0aa27 Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Project-Name: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d82a93c1cb9b4a4da7114874ddf0aa27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Tenant: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Tenant-Id: d82a93c1cb9b4a4da7114874ddf0aa27 Apr 18 16:20:31 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-AttachVolumeTestJSON-313351389 Apr 18 16:20:31 user devstack@n-api.service[61294]: X-User: tempest-AttachVolumeTestJSON-313351389-project-member Apr 18 16:20:31 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:20:31 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:20:31 user devstack@n-api.service[61294]: X-User-Id: fd46686fd5b845cca0f3d9452a86f4ca Apr 18 16:20:31 user devstack@n-api.service[61294]: X-User-Name: tempest-AttachVolumeTestJSON-313351389-project-member Apr 18 16:20:31 user devstack@n-api.service[61294]: method: > Apr 18 16:20:31 user devstack@n-api.service[61294]: exception: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. Apr 18 16:20:31 user devstack@n-api.service[61294]: action_args: {'id': '8e1ccfc5-90a7-443f-83e2-c07be27d6c7c'} Apr 18 16:20:31 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. Apr 18 16:20:31 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:20:31 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-d9969fe1-b0f6-42c8-bb4a-d1b9b7255dd4 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] Returning 404 to user: Instance 8e1ccfc5-90a7-443f-83e2-c07be27d6c7c could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:20:31 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-d9969fe1-b0f6-42c8-bb4a-d1b9b7255dd4 tempest-AttachVolumeTestJSON-313351389 tempest-AttachVolumeTestJSON-313351389-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c" status: 404 len: 111 microversion: 2.1 time: 0.026139 Apr 18 16:20:31 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 98/292] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:20:31 2023] GET /compute/v2.1/servers/8e1ccfc5-90a7-443f-83e2-c07be27d6c7c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 18 16:20:36 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-6279c596-9e27-451d-8865-7126f24af373 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:36 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-6279c596-9e27-451d-8865-7126f24af373 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] [instance: da82d905-1ca1-403d-9598-7561e69b9704] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:36 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6279c596-9e27-451d-8865-7126f24af373 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:36 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6279c596-9e27-451d-8865-7126f24af373 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:36 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6279c596-9e27-451d-8865-7126f24af373 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:36 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6279c596-9e27-451d-8865-7126f24af373 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:36 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6279c596-9e27-451d-8865-7126f24af373 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:36 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6279c596-9e27-451d-8865-7126f24af373 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:36 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-6279c596-9e27-451d-8865-7126f24af373 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] HTTP exception thrown: Instance da82d905-1ca1-403d-9598-7561e69b9704 could not be found. Apr 18 16:20:36 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-6279c596-9e27-451d-8865-7126f24af373 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Request method failure captured: Apr 18 16:20:36 user devstack@n-api.service[61295]: request: GET /compute/v2.1/servers/da82d905-1ca1-403d-9598-7561e69b9704 HTTP/1.1 Apr 18 16:20:36 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:20:36 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:20:36 user devstack@n-api.service[61295]: Connection: close Apr 18 16:20:36 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:20:36 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:20:36 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:20:36 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:20:36 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:20:36 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsHLexSujdbqOmIzkPAfq8iA0bip0o5ai6CR7o0XHulzA0AZglhiTE18ctCwUCvxYBrsXcLsoxBzmw3hW3Ny1RoxLwRzTuQnnsONGJJn13kFjd_NQGFV0ryMorqLrwgaLwUroimKrCH-CL9IbLN_JEgm-hYJW5nqpS0fJQwNXcKulhg Apr 18 16:20:36 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:20:36 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:20:36 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:20:36 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:20:36 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:20:36 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:20:36 user devstack@n-api.service[61295]: X-Project-Id: 261e8ba82d9e4203917afb0241a3b4fc Apr 18 16:20:36 user devstack@n-api.service[61295]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1586888284 Apr 18 16:20:36 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:20:36 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:20:36 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/261e8ba82d9e4203917afb0241a3b4fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/261e8ba82d9e4203917afb0241a3b4fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/261e8ba82d9e4203917afb0241a3b4fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:20:36 user devstack@n-api.service[61295]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1586888284 Apr 18 16:20:36 user devstack@n-api.service[61295]: X-Tenant-Id: 261e8ba82d9e4203917afb0241a3b4fc Apr 18 16:20:36 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1586888284 Apr 18 16:20:36 user devstack@n-api.service[61295]: X-User: tempest-ServerRescueNegativeTestJSON-1586888284-project-member Apr 18 16:20:36 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:20:36 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:20:36 user devstack@n-api.service[61295]: X-User-Id: a8a3f45f9c6c431781fb582b8da22b0b Apr 18 16:20:36 user devstack@n-api.service[61295]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1586888284-project-member Apr 18 16:20:36 user devstack@n-api.service[61295]: method: > Apr 18 16:20:36 user devstack@n-api.service[61295]: exception: Instance da82d905-1ca1-403d-9598-7561e69b9704 could not be found. Apr 18 16:20:36 user devstack@n-api.service[61295]: action_args: {'id': 'da82d905-1ca1-403d-9598-7561e69b9704'} Apr 18 16:20:36 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da82d905-1ca1-403d-9598-7561e69b9704 could not be found. Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da82d905-1ca1-403d-9598-7561e69b9704 could not be found. Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da82d905-1ca1-403d-9598-7561e69b9704 could not be found. Apr 18 16:20:36 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:20:36 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-6279c596-9e27-451d-8865-7126f24af373 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] Returning 404 to user: Instance da82d905-1ca1-403d-9598-7561e69b9704 could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:20:36 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-6279c596-9e27-451d-8865-7126f24af373 tempest-ServerRescueNegativeTestJSON-1586888284 tempest-ServerRescueNegativeTestJSON-1586888284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da82d905-1ca1-403d-9598-7561e69b9704" status: 404 len: 111 microversion: 2.1 time: 0.036371 Apr 18 16:20:36 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 99/293] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:20:36 2023] GET /compute/v2.1/servers/da82d905-1ca1-403d-9598-7561e69b9704 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1247400120", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "networks": [{"uuid": "a4882813-5e0c-44e4-b47a-bc4b69fbead5"}]}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG nova.network.neutron [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] validate_networks() for [('a4882813-5e0c-44e4-b47a-bc4b69fbead5', None, None, None, None, None)] {{(pid=61296) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Flavor limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Image limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Flavor pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Image pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Getting quotas for project fb49d5ddf6db4b1d807ba42fd37a919d. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Getting quotas for user 3e222f73f9194870b4fac305cdd60f3a and project fb49d5ddf6db4b1d807ba42fd37a919d. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Going to run 1 instances... {{(pid=61296) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:20:41 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] [instance: c16a352d-3f0c-4688-a890-81be1fee9f35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:20:41 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-f7a2af34-cd5a-4437-8d90-212c6ca43a25 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.795117 Apr 18 16:20:41 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 97/294] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:20:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:20:41 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-ddfdb192-0bb3-421a-8818-6d18f897e8a9 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:41 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-ddfdb192-0bb3-421a-8818-6d18f897e8a9 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] [instance: c16a352d-3f0c-4688-a890-81be1fee9f35] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:41 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-ddfdb192-0bb3-421a-8818-6d18f897e8a9 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e222f73f9194870b4fac305cdd60f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb49d5ddf6db4b1d807ba42fd37a919d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:20:41 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-ddfdb192-0bb3-421a-8818-6d18f897e8a9 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c16a352d-3f0c-4688-a890-81be1fee9f35" status: 200 len: 1208 microversion: 2.1 time: 0.073337 Apr 18 16:20:41 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 99/295] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:20:41 2023] GET /compute/v2.1/servers/c16a352d-3f0c-4688-a890-81be1fee9f35 => generated 1208 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:20:44 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-063209df-1df0-44d8-99a6-bb9ecef9bc20 req-d254d26b-a11c-4af0-8e18-387fb6af96f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c16a352d-3f0c-4688-a890-81be1fee9f35", "tag": "159a1d71-92e3-4ac2-ad79-f530a49580e9"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-063209df-1df0-44d8-99a6-bb9ecef9bc20 req-d254d26b-a11c-4af0-8e18-387fb6af96f3 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-063209df-1df0-44d8-99a6-bb9ecef9bc20 req-d254d26b-a11c-4af0-8e18-387fb6af96f3 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-063209df-1df0-44d8-99a6-bb9ecef9bc20 req-d254d26b-a11c-4af0-8e18-387fb6af96f3 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:44 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-063209df-1df0-44d8-99a6-bb9ecef9bc20 req-d254d26b-a11c-4af0-8e18-387fb6af96f3 service nova] Creating event network-changed:159a1d71-92e3-4ac2-ad79-f530a49580e9 for instance c16a352d-3f0c-4688-a890-81be1fee9f35 on user Apr 18 16:20:44 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-063209df-1df0-44d8-99a6-bb9ecef9bc20 req-d254d26b-a11c-4af0-8e18-387fb6af96f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029656 Apr 18 16:20:44 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 100/296] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:20:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:20:47 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-1095e39a-f458-4a06-84fd-9a1f7a54fd84 req-16fd06e2-82c3-47e8-ac79-8709f50d0ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c16a352d-3f0c-4688-a890-81be1fee9f35", "name": "network-vif-plugged", "status": "completed", "tag": "159a1d71-92e3-4ac2-ad79-f530a49580e9"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:47 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-1095e39a-f458-4a06-84fd-9a1f7a54fd84 req-16fd06e2-82c3-47e8-ac79-8709f50d0ac0 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:47 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-1095e39a-f458-4a06-84fd-9a1f7a54fd84 req-16fd06e2-82c3-47e8-ac79-8709f50d0ac0 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:47 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-1095e39a-f458-4a06-84fd-9a1f7a54fd84 req-16fd06e2-82c3-47e8-ac79-8709f50d0ac0 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:47 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-1095e39a-f458-4a06-84fd-9a1f7a54fd84 req-16fd06e2-82c3-47e8-ac79-8709f50d0ac0 service nova] Creating event network-vif-plugged:159a1d71-92e3-4ac2-ad79-f530a49580e9 for instance c16a352d-3f0c-4688-a890-81be1fee9f35 on user Apr 18 16:20:47 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-1095e39a-f458-4a06-84fd-9a1f7a54fd84 req-16fd06e2-82c3-47e8-ac79-8709f50d0ac0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035392 Apr 18 16:20:47 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 98/297] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:20:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:20:48 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-0b3ec1c2-4a67-4133-8951-2cef9b0e50fb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:48 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-0b3ec1c2-4a67-4133-8951-2cef9b0e50fb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f6d6085d-9e15-4e29-ab90-3a8928971324] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:48 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=10 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:20:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0b3ec1c2-4a67-4133-8951-2cef9b0e50fb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0b3ec1c2-4a67-4133-8951-2cef9b0e50fb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0b3ec1c2-4a67-4133-8951-2cef9b0e50fb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0b3ec1c2-4a67-4133-8951-2cef9b0e50fb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0b3ec1c2-4a67-4133-8951-2cef9b0e50fb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0b3ec1c2-4a67-4133-8951-2cef9b0e50fb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:48 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-0b3ec1c2-4a67-4133-8951-2cef9b0e50fb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af90e17ec027463fa8793e8539c39e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4e8d8797be4c0e91b1401538f2eba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:20:48 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-0b3ec1c2-4a67-4133-8951-2cef9b0e50fb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324" status: 200 len: 1543 microversion: 2.1 time: 0.320170 Apr 18 16:20:48 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 100/298] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:20:48 2023] GET /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324 => generated 1543 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:20:49 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-a4c507c7-ebad-4fd6-8931-93d24b37bb85 req-3fa5f43e-a6b5-4d50-b7ae-40a92eec8614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c16a352d-3f0c-4688-a890-81be1fee9f35", "name": "network-vif-plugged", "status": "completed", "tag": "159a1d71-92e3-4ac2-ad79-f530a49580e9"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-a4c507c7-ebad-4fd6-8931-93d24b37bb85 req-3fa5f43e-a6b5-4d50-b7ae-40a92eec8614 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-a4c507c7-ebad-4fd6-8931-93d24b37bb85 req-3fa5f43e-a6b5-4d50-b7ae-40a92eec8614 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-a4c507c7-ebad-4fd6-8931-93d24b37bb85 req-3fa5f43e-a6b5-4d50-b7ae-40a92eec8614 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:49 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-a4c507c7-ebad-4fd6-8931-93d24b37bb85 req-3fa5f43e-a6b5-4d50-b7ae-40a92eec8614 service nova] Creating event network-vif-plugged:159a1d71-92e3-4ac2-ad79-f530a49580e9 for instance c16a352d-3f0c-4688-a890-81be1fee9f35 on user Apr 18 16:20:49 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-a4c507c7-ebad-4fd6-8931-93d24b37bb85 req-3fa5f43e-a6b5-4d50-b7ae-40a92eec8614 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030083 Apr 18 16:20:49 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 101/299] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:20:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:20:50 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1356234404", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "networks": [{"uuid": "236fa8aa-433b-4dfa-a787-f165c3389489"}]}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:50 user devstack@n-api.service[61296]: DEBUG nova.network.neutron [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] validate_networks() for [('236fa8aa-433b-4dfa-a787-f165c3389489', None, None, None, None, None)] {{(pid=61296) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:20:51 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Flavor limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:20:51 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Image limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:20:51 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Flavor pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:20:51 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Image pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:20:51 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:20:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:51 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Getting quotas for project 5695adbb14ea4162bc40547b1509a1e4. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:20:51 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Getting quotas for user 2963911de4f34d79816a9a1f9ad24a27 and project 5695adbb14ea4162bc40547b1509a1e4. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:20:51 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Going to run 1 instances... {{(pid=61296) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:20:51 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: 66df9389-d007-4737-8bb1-55bcb5f227ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:20:51 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-cd985294-337e-4f05-8b4b-895bb806307b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.805165 Apr 18 16:20:51 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 99/300] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:20:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:20:51 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-780d5d43-2a28-4dd6-b814-89a327a48eb3 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:51 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-780d5d43-2a28-4dd6-b814-89a327a48eb3 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: 66df9389-d007-4737-8bb1-55bcb5f227ff] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:51 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-780d5d43-2a28-4dd6-b814-89a327a48eb3 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2963911de4f34d79816a9a1f9ad24a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5695adbb14ea4162bc40547b1509a1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:20:51 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-780d5d43-2a28-4dd6-b814-89a327a48eb3 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff" status: 200 len: 1211 microversion: 2.1 time: 0.072462 Apr 18 16:20:51 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 101/301] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:20:51 2023] GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff => generated 1211 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 16:20:54 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-d131cad2-e124-467e-b39c-d3e0cba48295 req-5f879130-854a-43b1-911d-df4784c10569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66df9389-d007-4737-8bb1-55bcb5f227ff", "tag": "b66d41ab-873c-4826-a3f8-d4f4276fff10"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:54 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-d131cad2-e124-467e-b39c-d3e0cba48295 req-5f879130-854a-43b1-911d-df4784c10569 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:54 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-d131cad2-e124-467e-b39c-d3e0cba48295 req-5f879130-854a-43b1-911d-df4784c10569 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:54 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-d131cad2-e124-467e-b39c-d3e0cba48295 req-5f879130-854a-43b1-911d-df4784c10569 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:54 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-d131cad2-e124-467e-b39c-d3e0cba48295 req-5f879130-854a-43b1-911d-df4784c10569 service nova] Creating event network-changed:b66d41ab-873c-4826-a3f8-d4f4276fff10 for instance 66df9389-d007-4737-8bb1-55bcb5f227ff on user Apr 18 16:20:54 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-d131cad2-e124-467e-b39c-d3e0cba48295 req-5f879130-854a-43b1-911d-df4784c10569 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031782 Apr 18 16:20:54 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 102/302] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:20:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:20:55 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-d8eb4b1a-cccd-43ba-a0d8-462697722b9f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:55 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-d8eb4b1a-cccd-43ba-a0d8-462697722b9f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d8eb4b1a-cccd-43ba-a0d8-462697722b9f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d8eb4b1a-cccd-43ba-a0d8-462697722b9f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d8eb4b1a-cccd-43ba-a0d8-462697722b9f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d8eb4b1a-cccd-43ba-a0d8-462697722b9f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d8eb4b1a-cccd-43ba-a0d8-462697722b9f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-d8eb4b1a-cccd-43ba-a0d8-462697722b9f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:55 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-d8eb4b1a-cccd-43ba-a0d8-462697722b9f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b7b9d8fdcf42f29e83e755f4f27380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa61b19cc4e4cd4bb7d41291c40ef1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:20:55 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-d8eb4b1a-cccd-43ba-a0d8-462697722b9f tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 200 len: 1658 microversion: 2.1 time: 0.243625 Apr 18 16:20:55 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 100/303] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:20:55 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 1658 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:20:55 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-f6ad497c-09ee-4c00-9b28-271873817bc1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:55 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-f6ad497c-09ee-4c00-9b28-271873817bc1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-f6ad497c-09ee-4c00-9b28-271873817bc1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-f6ad497c-09ee-4c00-9b28-271873817bc1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-f6ad497c-09ee-4c00-9b28-271873817bc1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-f6ad497c-09ee-4c00-9b28-271873817bc1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-f6ad497c-09ee-4c00-9b28-271873817bc1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:55 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-f6ad497c-09ee-4c00-9b28-271873817bc1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:56 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-f6ad497c-09ee-4c00-9b28-271873817bc1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b7b9d8fdcf42f29e83e755f4f27380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa61b19cc4e4cd4bb7d41291c40ef1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:20:56 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-f6ad497c-09ee-4c00-9b28-271873817bc1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 200 len: 1658 microversion: 2.1 time: 0.541693 Apr 18 16:20:56 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 102/304] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:20:55 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 1658 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:20:56 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-08842788-170d-4ac8-bec7-71693a157fe1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:56 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-08842788-170d-4ac8-bec7-71693a157fe1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:56 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-08842788-170d-4ac8-bec7-71693a157fe1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:56 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-08842788-170d-4ac8-bec7-71693a157fe1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:56 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-08842788-170d-4ac8-bec7-71693a157fe1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:56 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-08842788-170d-4ac8-bec7-71693a157fe1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:56 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-08842788-170d-4ac8-bec7-71693a157fe1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:56 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-08842788-170d-4ac8-bec7-71693a157fe1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:56 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-08842788-170d-4ac8-bec7-71693a157fe1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b7b9d8fdcf42f29e83e755f4f27380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa61b19cc4e4cd4bb7d41291c40ef1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:20:56 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-08842788-170d-4ac8-bec7-71693a157fe1 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 200 len: 1658 microversion: 2.1 time: 0.222717 Apr 18 16:20:56 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 103/305] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:20:56 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 1658 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:20:56 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-05a002ab-bccd-45f3-8593-8e9ef29d3bf5 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:56 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-05a002ab-bccd-45f3-8593-8e9ef29d3bf5 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] [instance: 5f4e6f9b-5413-4399-83ca-9bc78911db38] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:56 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-05a002ab-bccd-45f3-8593-8e9ef29d3bf5 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:56 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-05a002ab-bccd-45f3-8593-8e9ef29d3bf5 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:56 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-05a002ab-bccd-45f3-8593-8e9ef29d3bf5 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:56 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-05a002ab-bccd-45f3-8593-8e9ef29d3bf5 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:56 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-05a002ab-bccd-45f3-8593-8e9ef29d3bf5 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:56 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-05a002ab-bccd-45f3-8593-8e9ef29d3bf5 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:57 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-05a002ab-bccd-45f3-8593-8e9ef29d3bf5 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01da22d0c8c4ee580567646e279d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '000fb9c948224fe3b595882d36cfb859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:20:57 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-05a002ab-bccd-45f3-8593-8e9ef29d3bf5 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f4e6f9b-5413-4399-83ca-9bc78911db38" status: 200 len: 1567 microversion: 2.1 time: 0.324612 Apr 18 16:20:57 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 101/306] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:20:56 2023] GET /compute/v2.1/servers/5f4e6f9b-5413-4399-83ca-9bc78911db38 => generated 1567 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:20:57 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-c44549c5-6c55-4f91-bf8c-bdfa41737b51 req-6836aad1-e2a1-4bac-aca8-7e865ede39a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66df9389-d007-4737-8bb1-55bcb5f227ff", "name": "network-vif-plugged", "status": "completed", "tag": "b66d41ab-873c-4826-a3f8-d4f4276fff10"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-c44549c5-6c55-4f91-bf8c-bdfa41737b51 req-6836aad1-e2a1-4bac-aca8-7e865ede39a3 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-c44549c5-6c55-4f91-bf8c-bdfa41737b51 req-6836aad1-e2a1-4bac-aca8-7e865ede39a3 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-c44549c5-6c55-4f91-bf8c-bdfa41737b51 req-6836aad1-e2a1-4bac-aca8-7e865ede39a3 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:57 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-c44549c5-6c55-4f91-bf8c-bdfa41737b51 req-6836aad1-e2a1-4bac-aca8-7e865ede39a3 service nova] Creating event network-vif-plugged:b66d41ab-873c-4826-a3f8-d4f4276fff10 for instance 66df9389-d007-4737-8bb1-55bcb5f227ff on user Apr 18 16:20:57 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-c44549c5-6c55-4f91-bf8c-bdfa41737b51 req-6836aad1-e2a1-4bac-aca8-7e865ede39a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041297 Apr 18 16:20:57 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 103/307] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:20:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:20:57 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-934050090", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "923d10dc-c67e-4426-9c6e-856e903e2446"}]}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:57 user devstack@n-api.service[61295]: DEBUG nova.network.neutron [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] validate_networks() for [('923d10dc-c67e-4426-9c6e-856e903e2446', None, None, None, None, None)] {{(pid=61295) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:20:58 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Flavor limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:20:58 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Image limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:20:58 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Flavor pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:20:58 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Image pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:20:58 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:20:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:58 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Getting quotas for project f516f5ec45ca4508841c77f79e8c038b. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:20:58 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Getting quotas for user c54c277689214bd0a2cadb1e2ac288a9 and project f516f5ec45ca4508841c77f79e8c038b. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:20:58 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Going to run 1 instances... {{(pid=61295) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:20:58 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 5e79a758-6aed-4536-bb5d-1a905ec5d28d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:20:58 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-3b4d31ce-6713-473e-8e4a-51f0f3371c7c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.579760 Apr 18 16:20:58 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 104/308] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 16:20:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 16:20:58 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-5a5fac12-2386-42de-9242-8da7e2c592ee tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:20:58 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-5a5fac12-2386-42de-9242-8da7e2c592ee tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 5e79a758-6aed-4536-bb5d-1a905ec5d28d] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:20:58 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-5a5fac12-2386-42de-9242-8da7e2c592ee tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:20:58 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-5a5fac12-2386-42de-9242-8da7e2c592ee tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:20:58 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-5a5fac12-2386-42de-9242-8da7e2c592ee tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:20:58 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-5a5fac12-2386-42de-9242-8da7e2c592ee tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e79a758-6aed-4536-bb5d-1a905ec5d28d" status: 200 len: 1394 microversion: 2.87 time: 0.096359 Apr 18 16:20:58 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 102/309] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:20:58 2023] GET /compute/v2.1/servers/5e79a758-6aed-4536-bb5d-1a905ec5d28d => generated 1394 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:20:59 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-cd61bc88-a47a-4739-93db-a1df1f6e863d req-046aa720-f40f-4f0e-a1c1-b17ca7792190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66df9389-d007-4737-8bb1-55bcb5f227ff", "name": "network-vif-plugged", "status": "completed", "tag": "b66d41ab-873c-4826-a3f8-d4f4276fff10"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:20:59 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-cd61bc88-a47a-4739-93db-a1df1f6e863d req-046aa720-f40f-4f0e-a1c1-b17ca7792190 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:20:59 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-cd61bc88-a47a-4739-93db-a1df1f6e863d req-046aa720-f40f-4f0e-a1c1-b17ca7792190 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:20:59 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-cd61bc88-a47a-4739-93db-a1df1f6e863d req-046aa720-f40f-4f0e-a1c1-b17ca7792190 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:20:59 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-cd61bc88-a47a-4739-93db-a1df1f6e863d req-046aa720-f40f-4f0e-a1c1-b17ca7792190 service nova] Creating event network-vif-plugged:b66d41ab-873c-4826-a3f8-d4f4276fff10 for instance 66df9389-d007-4737-8bb1-55bcb5f227ff on user Apr 18 16:20:59 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-cd61bc88-a47a-4739-93db-a1df1f6e863d req-046aa720-f40f-4f0e-a1c1-b17ca7792190 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049281 Apr 18 16:20:59 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 104/310] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:20:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:21:00 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-3e287364-413b-4600-972a-63cd5beca62f req-72e0c7a8-d825-4344-b67f-3c50e25718bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e79a758-6aed-4536-bb5d-1a905ec5d28d", "tag": "04c99cbe-321c-4c83-a015-4ad99a7b84a8"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:21:00 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-3e287364-413b-4600-972a-63cd5beca62f req-72e0c7a8-d825-4344-b67f-3c50e25718bb service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-3e287364-413b-4600-972a-63cd5beca62f req-72e0c7a8-d825-4344-b67f-3c50e25718bb service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-3e287364-413b-4600-972a-63cd5beca62f req-72e0c7a8-d825-4344-b67f-3c50e25718bb service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:00 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=21 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:00 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-3e287364-413b-4600-972a-63cd5beca62f req-72e0c7a8-d825-4344-b67f-3c50e25718bb service nova] Creating event network-changed:04c99cbe-321c-4c83-a015-4ad99a7b84a8 for instance 5e79a758-6aed-4536-bb5d-1a905ec5d28d on user Apr 18 16:21:00 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-3e287364-413b-4600-972a-63cd5beca62f req-72e0c7a8-d825-4344-b67f-3c50e25718bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045293 Apr 18 16:21:00 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 105/311] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:21:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:21:06 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-f8455bd8-daf0-4a27-8a97-15ef4622109a req-dcff0705-10b3-4853-bcc8-840d9f4354f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e79a758-6aed-4536-bb5d-1a905ec5d28d", "name": "network-vif-deleted", "tag": "04c99cbe-321c-4c83-a015-4ad99a7b84a8"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:21:06 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=4 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:06 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:06 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-f8455bd8-daf0-4a27-8a97-15ef4622109a req-dcff0705-10b3-4853-bcc8-840d9f4354f3 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:06 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-f8455bd8-daf0-4a27-8a97-15ef4622109a req-dcff0705-10b3-4853-bcc8-840d9f4354f3 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:06 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-f8455bd8-daf0-4a27-8a97-15ef4622109a req-dcff0705-10b3-4853-bcc8-840d9f4354f3 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:06 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=21 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:06 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.compute.server_external_events [req-f8455bd8-daf0-4a27-8a97-15ef4622109a req-dcff0705-10b3-4853-bcc8-840d9f4354f3 service nova] Unable to find a host for instance 5e79a758-6aed-4536-bb5d-1a905ec5d28d. Dropping event network-vif-deleted {{(pid=61296) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 18 16:21:06 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-f8455bd8-daf0-4a27-8a97-15ef4622109a req-dcff0705-10b3-4853-bcc8-840d9f4354f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.031504 Apr 18 16:21:06 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 103/312] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:21:06 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 18 16:21:30 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=4 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:30 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=22 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:30 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=16 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:30 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-e3292987-f350-4edb-b7ac-f634d6efa6f6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:30 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-e3292987-f350-4edb-b7ac-f634d6efa6f6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: f5496c5f-292e-4912-991b-f834009e51a1] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:30 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e3292987-f350-4edb-b7ac-f634d6efa6f6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:30 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e3292987-f350-4edb-b7ac-f634d6efa6f6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:30 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e3292987-f350-4edb-b7ac-f634d6efa6f6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:30 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e3292987-f350-4edb-b7ac-f634d6efa6f6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:30 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e3292987-f350-4edb-b7ac-f634d6efa6f6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:30 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e3292987-f350-4edb-b7ac-f634d6efa6f6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:30 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-e3292987-f350-4edb-b7ac-f634d6efa6f6 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.163115 Apr 18 16:21:30 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 105/313] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 18 16:21:30 2023] GET /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1/os-interface => generated 282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 16:21:30 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:30 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=6 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:30 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:30 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-f9a75b2c-80cd-4dda-b672-af07df54f993 req-23617ec2-f1c8-4cc2-bebc-339833ba64ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5496c5f-292e-4912-991b-f834009e51a1", "tag": "4d7beeed-1a0b-490b-a788-3b8442f86758"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:21:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-f9a75b2c-80cd-4dda-b672-af07df54f993 req-23617ec2-f1c8-4cc2-bebc-339833ba64ab service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-f9a75b2c-80cd-4dda-b672-af07df54f993 req-23617ec2-f1c8-4cc2-bebc-339833ba64ab service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-f9a75b2c-80cd-4dda-b672-af07df54f993 req-23617ec2-f1c8-4cc2-bebc-339833ba64ab service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:30 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-f9a75b2c-80cd-4dda-b672-af07df54f993 req-23617ec2-f1c8-4cc2-bebc-339833ba64ab service nova] Creating event network-changed:4d7beeed-1a0b-490b-a788-3b8442f86758 for instance f5496c5f-292e-4912-991b-f834009e51a1 on user Apr 18 16:21:30 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-f9a75b2c-80cd-4dda-b672-af07df54f993 req-23617ec2-f1c8-4cc2-bebc-339833ba64ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039362 Apr 18 16:21:30 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 106/314] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:21:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:21:30 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-170ddbec-264f-46b0-9dc5-b079e101d036 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:30 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-170ddbec-264f-46b0-9dc5-b079e101d036 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: f5496c5f-292e-4912-991b-f834009e51a1] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:30 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=14 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:30 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:30 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:30 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-170ddbec-264f-46b0-9dc5-b079e101d036 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:30 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-170ddbec-264f-46b0-9dc5-b079e101d036 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:30 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-170ddbec-264f-46b0-9dc5-b079e101d036 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:30 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-170ddbec-264f-46b0-9dc5-b079e101d036 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:30 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-170ddbec-264f-46b0-9dc5-b079e101d036 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:30 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-170ddbec-264f-46b0-9dc5-b079e101d036 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:31 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-170ddbec-264f-46b0-9dc5-b079e101d036 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1/ips" status: 200 len: 110 microversion: 2.20 time: 0.042990 Apr 18 16:21:31 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 104/315] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 18 16:21:30 2023] GET /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1/ips => generated 110 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 16:21:31 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-8befc488-7e94-4f2c-b8a9-52616280cde6 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:31 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-8befc488-7e94-4f2c-b8a9-52616280cde6 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] [instance: c16a352d-3f0c-4688-a890-81be1fee9f35] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8befc488-7e94-4f2c-b8a9-52616280cde6 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8befc488-7e94-4f2c-b8a9-52616280cde6 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8befc488-7e94-4f2c-b8a9-52616280cde6 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8befc488-7e94-4f2c-b8a9-52616280cde6 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8befc488-7e94-4f2c-b8a9-52616280cde6 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:31 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-8befc488-7e94-4f2c-b8a9-52616280cde6 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:32 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-8befc488-7e94-4f2c-b8a9-52616280cde6 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e222f73f9194870b4fac305cdd60f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb49d5ddf6db4b1d807ba42fd37a919d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:21:32 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-8befc488-7e94-4f2c-b8a9-52616280cde6 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c16a352d-3f0c-4688-a890-81be1fee9f35" status: 200 len: 1486 microversion: 2.1 time: 0.229832 Apr 18 16:21:32 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 106/316] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:21:31 2023] GET /compute/v2.1/servers/c16a352d-3f0c-4688-a890-81be1fee9f35 => generated 1486 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:21:32 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-ed1c6b26-2580-404e-8880-13635bfc33a5 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:32 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-ed1c6b26-2580-404e-8880-13635bfc33a5 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: f5496c5f-292e-4912-991b-f834009e51a1] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:32 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ed1c6b26-2580-404e-8880-13635bfc33a5 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:32 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ed1c6b26-2580-404e-8880-13635bfc33a5 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:32 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ed1c6b26-2580-404e-8880-13635bfc33a5 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:32 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ed1c6b26-2580-404e-8880-13635bfc33a5 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:32 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ed1c6b26-2580-404e-8880-13635bfc33a5 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:32 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-ed1c6b26-2580-404e-8880-13635bfc33a5 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:32 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-ed1c6b26-2580-404e-8880-13635bfc33a5 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: f5496c5f-292e-4912-991b-f834009e51a1] Going to try to terminate instance {{(pid=61295) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:21:32 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-ed1c6b26-2580-404e-8880-13635bfc33a5 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1" status: 204 len: 0 microversion: 2.20 time: 0.117164 Apr 18 16:21:32 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 107/317] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 16:21:32 2023] DELETE /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 16:21:32 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-fd6769b9-d202-4cdc-89cf-3268fbb10e33 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:32 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-fd6769b9-d202-4cdc-89cf-3268fbb10e33 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: f5496c5f-292e-4912-991b-f834009e51a1] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:32 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-fd6769b9-d202-4cdc-89cf-3268fbb10e33 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:32 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-fd6769b9-d202-4cdc-89cf-3268fbb10e33 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:32 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-fd6769b9-d202-4cdc-89cf-3268fbb10e33 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:32 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-fd6769b9-d202-4cdc-89cf-3268fbb10e33 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:32 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-fd6769b9-d202-4cdc-89cf-3268fbb10e33 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:32 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-fd6769b9-d202-4cdc-89cf-3268fbb10e33 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:32 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-5687a1fb-92ad-4df3-a163-e9d7c71aca9c req-3cc797aa-297e-4bfb-b2a3-10f0188ffdb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5496c5f-292e-4912-991b-f834009e51a1", "name": "network-vif-unplugged", "status": "completed", "tag": "4d7beeed-1a0b-490b-a788-3b8442f86758"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:21:32 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-5687a1fb-92ad-4df3-a163-e9d7c71aca9c req-3cc797aa-297e-4bfb-b2a3-10f0188ffdb2 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:32 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-5687a1fb-92ad-4df3-a163-e9d7c71aca9c req-3cc797aa-297e-4bfb-b2a3-10f0188ffdb2 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:32 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-5687a1fb-92ad-4df3-a163-e9d7c71aca9c req-3cc797aa-297e-4bfb-b2a3-10f0188ffdb2 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:32 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-5687a1fb-92ad-4df3-a163-e9d7c71aca9c req-3cc797aa-297e-4bfb-b2a3-10f0188ffdb2 service nova] Creating event network-vif-unplugged:4d7beeed-1a0b-490b-a788-3b8442f86758 for instance f5496c5f-292e-4912-991b-f834009e51a1 on user Apr 18 16:21:32 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-5687a1fb-92ad-4df3-a163-e9d7c71aca9c req-3cc797aa-297e-4bfb-b2a3-10f0188ffdb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027915 Apr 18 16:21:32 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 107/318] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:21:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:21:32 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-fd6769b9-d202-4cdc-89cf-3268fbb10e33 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:21:32 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-fd6769b9-d202-4cdc-89cf-3268fbb10e33 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:21:32 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-fd6769b9-d202-4cdc-89cf-3268fbb10e33 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73a99bbf510f4f67bb7a35901ba3edc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9987eeaa6b24ca48e80e8d5318f02ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:21:32 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-fd6769b9-d202-4cdc-89cf-3268fbb10e33 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1" status: 200 len: 1712 microversion: 2.20 time: 0.434932 Apr 18 16:21:32 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 105/319] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:21:32 2023] GET /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1 => generated 1712 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:21:33 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-8b652470-ba81-4cfb-85ab-c4b646e5df5b req-146bc672-e1a4-484b-a0f3-d396bf3b31ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5496c5f-292e-4912-991b-f834009e51a1", "name": "network-vif-deleted", "tag": "4d7beeed-1a0b-490b-a788-3b8442f86758"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:21:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-8b652470-ba81-4cfb-85ab-c4b646e5df5b req-146bc672-e1a4-484b-a0f3-d396bf3b31ce service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-8b652470-ba81-4cfb-85ab-c4b646e5df5b req-146bc672-e1a4-484b-a0f3-d396bf3b31ce service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-8b652470-ba81-4cfb-85ab-c4b646e5df5b req-146bc672-e1a4-484b-a0f3-d396bf3b31ce service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:33 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-8b652470-ba81-4cfb-85ab-c4b646e5df5b req-146bc672-e1a4-484b-a0f3-d396bf3b31ce service nova] Creating event network-vif-deleted:4d7beeed-1a0b-490b-a788-3b8442f86758 for instance f5496c5f-292e-4912-991b-f834009e51a1 on user Apr 18 16:21:33 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-8b652470-ba81-4cfb-85ab-c4b646e5df5b req-146bc672-e1a4-484b-a0f3-d396bf3b31ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029055 Apr 18 16:21:33 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 108/320] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:21:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:21:34 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-39501554-6ec7-43c0-b17c-f3cc4b287718 req-039a2987-077c-4fd5-a91a-5df0fc07e610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5496c5f-292e-4912-991b-f834009e51a1", "name": "network-vif-plugged", "status": "completed", "tag": "4d7beeed-1a0b-490b-a788-3b8442f86758"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:21:34 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-39501554-6ec7-43c0-b17c-f3cc4b287718 req-039a2987-077c-4fd5-a91a-5df0fc07e610 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:34 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-39501554-6ec7-43c0-b17c-f3cc4b287718 req-039a2987-077c-4fd5-a91a-5df0fc07e610 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:34 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-39501554-6ec7-43c0-b17c-f3cc4b287718 req-039a2987-077c-4fd5-a91a-5df0fc07e610 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:34 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-39501554-6ec7-43c0-b17c-f3cc4b287718 req-039a2987-077c-4fd5-a91a-5df0fc07e610 service nova] Creating event network-vif-plugged:4d7beeed-1a0b-490b-a788-3b8442f86758 for instance f5496c5f-292e-4912-991b-f834009e51a1 on user Apr 18 16:21:34 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-39501554-6ec7-43c0-b17c-f3cc4b287718 req-039a2987-077c-4fd5-a91a-5df0fc07e610 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030426 Apr 18 16:21:34 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 108/321] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:21:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:21:41 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-57398283-20e2-4628-a670-5076b310c3be tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:41 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-57398283-20e2-4628-a670-5076b310c3be tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: 66df9389-d007-4737-8bb1-55bcb5f227ff] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:41 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-57398283-20e2-4628-a670-5076b310c3be tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:41 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-57398283-20e2-4628-a670-5076b310c3be tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:41 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-57398283-20e2-4628-a670-5076b310c3be tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:41 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-57398283-20e2-4628-a670-5076b310c3be tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:41 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-57398283-20e2-4628-a670-5076b310c3be tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:41 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-57398283-20e2-4628-a670-5076b310c3be tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:41 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-57398283-20e2-4628-a670-5076b310c3be tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2963911de4f34d79816a9a1f9ad24a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5695adbb14ea4162bc40547b1509a1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:21:41 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-57398283-20e2-4628-a670-5076b310c3be tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff" status: 200 len: 1495 microversion: 2.1 time: 0.230465 Apr 18 16:21:41 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 106/322] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:21:41 2023] GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff => generated 1495 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-bd08b8f8-f3ac-4768-a5fe-c79099e3c177 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-bd08b8f8-f3ac-4768-a5fe-c79099e3c177 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 5e79a758-6aed-4536-bb5d-1a905ec5d28d] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-bd08b8f8-f3ac-4768-a5fe-c79099e3c177 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-bd08b8f8-f3ac-4768-a5fe-c79099e3c177 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-bd08b8f8-f3ac-4768-a5fe-c79099e3c177 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-bd08b8f8-f3ac-4768-a5fe-c79099e3c177 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-bd08b8f8-f3ac-4768-a5fe-c79099e3c177 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-bd08b8f8-f3ac-4768-a5fe-c79099e3c177 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:48 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=8 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:48 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=14 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:21:48 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-e181f6da-f7e2-4287-b92f-d7903f3fba8b tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:48 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-e181f6da-f7e2-4287-b92f-d7903f3fba8b tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f6d6085d-9e15-4e29-ab90-3a8928971324] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e181f6da-f7e2-4287-b92f-d7903f3fba8b tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e181f6da-f7e2-4287-b92f-d7903f3fba8b tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e181f6da-f7e2-4287-b92f-d7903f3fba8b tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e181f6da-f7e2-4287-b92f-d7903f3fba8b tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e181f6da-f7e2-4287-b92f-d7903f3fba8b tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e181f6da-f7e2-4287-b92f-d7903f3fba8b tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-bd08b8f8-f3ac-4768-a5fe-c79099e3c177 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-bd08b8f8-f3ac-4768-a5fe-c79099e3c177 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-bd08b8f8-f3ac-4768-a5fe-c79099e3c177 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG nova.objects.instance [None req-bd08b8f8-f3ac-4768-a5fe-c79099e3c177 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lazy-loading 'fault' on Instance uuid 5e79a758-6aed-4536-bb5d-1a905ec5d28d {{(pid=61295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-bd08b8f8-f3ac-4768-a5fe-c79099e3c177 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-bd08b8f8-f3ac-4768-a5fe-c79099e3c177 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:21:48 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-bd08b8f8-f3ac-4768-a5fe-c79099e3c177 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:21:48 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-bd08b8f8-f3ac-4768-a5fe-c79099e3c177 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e79a758-6aed-4536-bb5d-1a905ec5d28d" status: 200 len: 1649 microversion: 2.87 time: 0.145324 Apr 18 16:21:48 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 109/323] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:21:48 2023] GET /compute/v2.1/servers/5e79a758-6aed-4536-bb5d-1a905ec5d28d => generated 1649 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 5e79a758-6aed-4536-bb5d-1a905ec5d28d] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:48 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-e181f6da-f7e2-4287-b92f-d7903f3fba8b tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.169651 Apr 18 16:21:48 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 109/324] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 16:21:48 2023] GET /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324/os-interface => generated 282 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 5e79a758-6aed-4536-bb5d-1a905ec5d28d] Going to try to terminate instance {{(pid=61296) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 5e79a758-6aed-4536-bb5d-1a905ec5d28d] Doing local delete in cell 81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4(cell1) {{(pid=61296) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:48 user devstack@n-api.service[61296]: WARNING nova.compute.api [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 5e79a758-6aed-4536-bb5d-1a905ec5d28d] instance's host None is down, deleting from database Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG nova.network.neutron [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 5e79a758-6aed-4536-bb5d-1a905ec5d28d] deallocate_for_instance() {{(pid=61296) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG nova.network.neutron [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 5e79a758-6aed-4536-bb5d-1a905ec5d28d] Instance cache missing network info. {{(pid=61296) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG nova.network.neutron [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 5e79a758-6aed-4536-bb5d-1a905ec5d28d] Updating instance_info_cache with network_info: [] {{(pid=61296) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 18 16:21:48 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 5e79a758-6aed-4536-bb5d-1a905ec5d28d] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61296) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 18 16:21:48 user devstack@n-api.service[61296]: WARNING nova.compute.api [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 5e79a758-6aed-4536-bb5d-1a905ec5d28d] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 18 16:21:49 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-b49c4a1b-844b-4346-9ea8-80a381ad2454 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5e79a758-6aed-4536-bb5d-1a905ec5d28d" status: 204 len: 0 microversion: 2.87 time: 0.554017 Apr 18 16:21:49 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 107/325] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 16:21:48 2023] DELETE /compute/v2.1/servers/5e79a758-6aed-4536-bb5d-1a905ec5d28d => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 16:21:49 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-29448c07-672e-4e72-8624-df80051f1c13 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:49 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-29448c07-672e-4e72-8624-df80051f1c13 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 5e79a758-6aed-4536-bb5d-1a905ec5d28d] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-29448c07-672e-4e72-8624-df80051f1c13 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-29448c07-672e-4e72-8624-df80051f1c13 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-29448c07-672e-4e72-8624-df80051f1c13 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-29448c07-672e-4e72-8624-df80051f1c13 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-29448c07-672e-4e72-8624-df80051f1c13 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-29448c07-672e-4e72-8624-df80051f1c13 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:49 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-29448c07-672e-4e72-8624-df80051f1c13 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] HTTP exception thrown: Instance 5e79a758-6aed-4536-bb5d-1a905ec5d28d could not be found. Apr 18 16:21:49 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-29448c07-672e-4e72-8624-df80051f1c13 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Request method failure captured: Apr 18 16:21:49 user devstack@n-api.service[61295]: request: GET /compute/v2.1/servers/5e79a758-6aed-4536-bb5d-1a905ec5d28d HTTP/1.1 Apr 18 16:21:49 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:21:49 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:21:49 user devstack@n-api.service[61295]: Connection: close Apr 18 16:21:49 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:21:49 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:21:49 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:21:49 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:21:49 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:21:49 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsK2urU6zpYqUryz6kjpRn_xfxcKxINV1Fl_rLQYN2scVWoJVqIsK36YQ3bNyjICQcU8HREYr_ExKMh5uXEcfyIW1BrC1Xqz8VwomDMYtvOQk2GnF-AFhsloFkL0DmGDBdhjNiuaxvPgTkmTGjm-Y9koAadk2AwhEGpApMZnjVLcVrY Apr 18 16:21:49 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:21:49 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:21:49 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:21:49 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:21:49 user devstack@n-api.service[61295]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 16:21:49 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:21:49 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:21:49 user devstack@n-api.service[61295]: X-Project-Id: f516f5ec45ca4508841c77f79e8c038b Apr 18 16:21:49 user devstack@n-api.service[61295]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2021464272 Apr 18 16:21:49 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:21:49 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:21:49 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f516f5ec45ca4508841c77f79e8c038b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f516f5ec45ca4508841c77f79e8c038b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f516f5ec45ca4508841c77f79e8c038b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:21:49 user devstack@n-api.service[61295]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2021464272 Apr 18 16:21:49 user devstack@n-api.service[61295]: X-Tenant-Id: f516f5ec45ca4508841c77f79e8c038b Apr 18 16:21:49 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2021464272 Apr 18 16:21:49 user devstack@n-api.service[61295]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member Apr 18 16:21:49 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:21:49 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:21:49 user devstack@n-api.service[61295]: X-User-Id: c54c277689214bd0a2cadb1e2ac288a9 Apr 18 16:21:49 user devstack@n-api.service[61295]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member Apr 18 16:21:49 user devstack@n-api.service[61295]: method: > Apr 18 16:21:49 user devstack@n-api.service[61295]: exception: Instance 5e79a758-6aed-4536-bb5d-1a905ec5d28d could not be found. Apr 18 16:21:49 user devstack@n-api.service[61295]: action_args: {'id': '5e79a758-6aed-4536-bb5d-1a905ec5d28d'} Apr 18 16:21:49 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e79a758-6aed-4536-bb5d-1a905ec5d28d could not be found. Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e79a758-6aed-4536-bb5d-1a905ec5d28d could not be found. Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e79a758-6aed-4536-bb5d-1a905ec5d28d could not be found. Apr 18 16:21:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:21:49 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-29448c07-672e-4e72-8624-df80051f1c13 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Returning 404 to user: Instance 5e79a758-6aed-4536-bb5d-1a905ec5d28d could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:21:49 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-29448c07-672e-4e72-8624-df80051f1c13 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e79a758-6aed-4536-bb5d-1a905ec5d28d" status: 404 len: 111 microversion: 2.87 time: 0.032045 Apr 18 16:21:49 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 110/326] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:21:49 2023] GET /compute/v2.1/servers/5e79a758-6aed-4536-bb5d-1a905ec5d28d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 16:21:49 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1835828907", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "networks": [{"uuid": "923d10dc-c67e-4426-9c6e-856e903e2446"}]}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:21:49 user devstack@n-api.service[61294]: DEBUG nova.network.neutron [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] validate_networks() for [('923d10dc-c67e-4426-9c6e-856e903e2446', None, None, None, None, None)] {{(pid=61294) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:21:50 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-88c920f1-4fff-4193-b914-7c8a52e58876 req-6c37ad8b-00e2-4ead-8d86-7d99bcd693aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6d6085d-9e15-4e29-ab90-3a8928971324", "tag": "fb818849-31a0-4c25-b42d-ca19fe250ca6"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:21:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-88c920f1-4fff-4193-b914-7c8a52e58876 req-6c37ad8b-00e2-4ead-8d86-7d99bcd693aa service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-88c920f1-4fff-4193-b914-7c8a52e58876 req-6c37ad8b-00e2-4ead-8d86-7d99bcd693aa service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-88c920f1-4fff-4193-b914-7c8a52e58876 req-6c37ad8b-00e2-4ead-8d86-7d99bcd693aa service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:50 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-88c920f1-4fff-4193-b914-7c8a52e58876 req-6c37ad8b-00e2-4ead-8d86-7d99bcd693aa service nova] Creating event network-changed:fb818849-31a0-4c25-b42d-ca19fe250ca6 for instance f6d6085d-9e15-4e29-ab90-3a8928971324 on user Apr 18 16:21:50 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-88c920f1-4fff-4193-b914-7c8a52e58876 req-6c37ad8b-00e2-4ead-8d86-7d99bcd693aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032788 Apr 18 16:21:50 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 108/327] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:21:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:21:50 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-b7cf118c-ab61-49c2-b0e9-0647d52c477d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:50 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-b7cf118c-ab61-49c2-b0e9-0647d52c477d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f6d6085d-9e15-4e29-ab90-3a8928971324] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:50 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-b7cf118c-ab61-49c2-b0e9-0647d52c477d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:50 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-b7cf118c-ab61-49c2-b0e9-0647d52c477d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:50 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-b7cf118c-ab61-49c2-b0e9-0647d52c477d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:50 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-b7cf118c-ab61-49c2-b0e9-0647d52c477d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:50 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-b7cf118c-ab61-49c2-b0e9-0647d52c477d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:50 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-b7cf118c-ab61-49c2-b0e9-0647d52c477d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:50 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-b7cf118c-ab61-49c2-b0e9-0647d52c477d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324/ips" status: 200 len: 108 microversion: 2.1 time: 0.034334 Apr 18 16:21:50 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 111/328] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 16:21:50 2023] GET /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324/ips => generated 108 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:21:50 user devstack@n-api.service[61294]: DEBUG nova.virt.hardware [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Flavor limits 0:0:0 {{(pid=61294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:21:50 user devstack@n-api.service[61294]: DEBUG nova.virt.hardware [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Image limits 0:0:0 {{(pid=61294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:21:50 user devstack@n-api.service[61294]: DEBUG nova.virt.hardware [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Flavor pref 0:0:0 {{(pid=61294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:21:50 user devstack@n-api.service[61294]: DEBUG nova.virt.hardware [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Image pref 0:0:0 {{(pid=61294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:21:50 user devstack@n-api.service[61294]: DEBUG nova.virt.hardware [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:21:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:50 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Getting quotas for project f516f5ec45ca4508841c77f79e8c038b. Resources: {'cores', 'ram', 'instances'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:21:50 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Getting quotas for user c54c277689214bd0a2cadb1e2ac288a9 and project f516f5ec45ca4508841c77f79e8c038b. Resources: {'cores', 'ram', 'instances'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:21:50 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Going to run 1 instances... {{(pid=61294) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:21:50 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61294) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:21:50 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-e80ddbb0-b3b5-44d7-9369-ae66b9123b9d tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.068751 Apr 18 16:21:50 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 110/329] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 16:21:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 16:21:50 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-04fb2358-9592-44a3-90f9-348ce1d88824 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:50 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-04fb2358-9592-44a3-90f9-348ce1d88824 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:50 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-04fb2358-9592-44a3-90f9-348ce1d88824 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:21:50 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-04fb2358-9592-44a3-90f9-348ce1d88824 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:21:50 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-04fb2358-9592-44a3-90f9-348ce1d88824 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:21:50 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-04fb2358-9592-44a3-90f9-348ce1d88824 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6aece7dd-d545-4e26-9cb7-30ee0b01ebb2" status: 200 len: 1395 microversion: 2.87 time: 0.086638 Apr 18 16:21:50 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 109/330] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:21:50 2023] GET /compute/v2.1/servers/6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 => generated 1395 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:21:51 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-eb2ba928-b73a-44f9-9b4a-c941ca49aebb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:51 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-eb2ba928-b73a-44f9-9b4a-c941ca49aebb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f6d6085d-9e15-4e29-ab90-3a8928971324] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-eb2ba928-b73a-44f9-9b4a-c941ca49aebb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-eb2ba928-b73a-44f9-9b4a-c941ca49aebb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-eb2ba928-b73a-44f9-9b4a-c941ca49aebb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-eb2ba928-b73a-44f9-9b4a-c941ca49aebb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-eb2ba928-b73a-44f9-9b4a-c941ca49aebb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-eb2ba928-b73a-44f9-9b4a-c941ca49aebb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:51 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-eb2ba928-b73a-44f9-9b4a-c941ca49aebb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f6d6085d-9e15-4e29-ab90-3a8928971324] Going to try to terminate instance {{(pid=61295) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:21:51 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-eb2ba928-b73a-44f9-9b4a-c941ca49aebb tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324" status: 204 len: 0 microversion: 2.1 time: 0.109549 Apr 18 16:21:51 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 112/331] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:21:51 2023] DELETE /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:21:51 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-21ad48f9-6e50-4187-856f-9880cd2f806e tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:51 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-21ad48f9-6e50-4187-856f-9880cd2f806e tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f6d6085d-9e15-4e29-ab90-3a8928971324] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-21ad48f9-6e50-4187-856f-9880cd2f806e tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-21ad48f9-6e50-4187-856f-9880cd2f806e tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-21ad48f9-6e50-4187-856f-9880cd2f806e tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-21ad48f9-6e50-4187-856f-9880cd2f806e tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-21ad48f9-6e50-4187-856f-9880cd2f806e tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-21ad48f9-6e50-4187-856f-9880cd2f806e tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:51 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-21ad48f9-6e50-4187-856f-9880cd2f806e tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af90e17ec027463fa8793e8539c39e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b4e8d8797be4c0e91b1401538f2eba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:21:51 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-21ad48f9-6e50-4187-856f-9880cd2f806e tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324" status: 200 len: 1668 microversion: 2.1 time: 0.230266 Apr 18 16:21:51 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 111/332] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:21:51 2023] GET /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324 => generated 1668 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:21:51 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-66b6b5ae-8506-40e8-bcad-98555ef5eb52 req-b54135de-9df0-49ae-a729-06a680bc8e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d6085d-9e15-4e29-ab90-3a8928971324", "name": "network-vif-unplugged", "status": "completed", "tag": "fb818849-31a0-4c25-b42d-ca19fe250ca6"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:21:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-66b6b5ae-8506-40e8-bcad-98555ef5eb52 req-b54135de-9df0-49ae-a729-06a680bc8e18 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-66b6b5ae-8506-40e8-bcad-98555ef5eb52 req-b54135de-9df0-49ae-a729-06a680bc8e18 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-66b6b5ae-8506-40e8-bcad-98555ef5eb52 req-b54135de-9df0-49ae-a729-06a680bc8e18 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:51 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-66b6b5ae-8506-40e8-bcad-98555ef5eb52 req-b54135de-9df0-49ae-a729-06a680bc8e18 service nova] Creating event network-vif-unplugged:fb818849-31a0-4c25-b42d-ca19fe250ca6 for instance f6d6085d-9e15-4e29-ab90-3a8928971324 on user Apr 18 16:21:51 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-66b6b5ae-8506-40e8-bcad-98555ef5eb52 req-b54135de-9df0-49ae-a729-06a680bc8e18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027093 Apr 18 16:21:51 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 110/333] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:21:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:21:52 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-4fafaea9-b3b3-409a-8b78-852e45661979 req-4f785640-9116-4260-a027-b05adbd554d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aece7dd-d545-4e26-9cb7-30ee0b01ebb2", "tag": "8d71cc71-9d8c-428d-ad04-69a31a967fe9"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:21:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-4fafaea9-b3b3-409a-8b78-852e45661979 req-4f785640-9116-4260-a027-b05adbd554d6 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-4fafaea9-b3b3-409a-8b78-852e45661979 req-4f785640-9116-4260-a027-b05adbd554d6 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:52 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-4fafaea9-b3b3-409a-8b78-852e45661979 req-4f785640-9116-4260-a027-b05adbd554d6 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:52 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-4fafaea9-b3b3-409a-8b78-852e45661979 req-4f785640-9116-4260-a027-b05adbd554d6 service nova] Creating event network-changed:8d71cc71-9d8c-428d-ad04-69a31a967fe9 for instance 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 on user Apr 18 16:21:52 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-4fafaea9-b3b3-409a-8b78-852e45661979 req-4f785640-9116-4260-a027-b05adbd554d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028162 Apr 18 16:21:52 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 113/334] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:21:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:21:53 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-9f2e2782-65a2-4384-9e74-2ca99f28836f req-2a9b1633-098d-47b7-a9b0-7e6fc638716a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d6085d-9e15-4e29-ab90-3a8928971324", "name": "network-vif-deleted", "tag": "fb818849-31a0-4c25-b42d-ca19fe250ca6"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:21:53 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-9f2e2782-65a2-4384-9e74-2ca99f28836f req-2a9b1633-098d-47b7-a9b0-7e6fc638716a service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:53 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-9f2e2782-65a2-4384-9e74-2ca99f28836f req-2a9b1633-098d-47b7-a9b0-7e6fc638716a service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:53 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-9f2e2782-65a2-4384-9e74-2ca99f28836f req-2a9b1633-098d-47b7-a9b0-7e6fc638716a service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:53 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-9f2e2782-65a2-4384-9e74-2ca99f28836f req-2a9b1633-098d-47b7-a9b0-7e6fc638716a service nova] Creating event network-vif-deleted:fb818849-31a0-4c25-b42d-ca19fe250ca6 for instance f6d6085d-9e15-4e29-ab90-3a8928971324 on user Apr 18 16:21:53 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-9f2e2782-65a2-4384-9e74-2ca99f28836f req-2a9b1633-098d-47b7-a9b0-7e6fc638716a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062437 Apr 18 16:21:53 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 112/335] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:21:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:21:53 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-192365a9-feff-4073-ab6c-5fd1ce858338 req-8b8928bb-e17e-42aa-99e3-52a1b493d3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6d6085d-9e15-4e29-ab90-3a8928971324", "name": "network-vif-plugged", "status": "completed", "tag": "fb818849-31a0-4c25-b42d-ca19fe250ca6"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:21:53 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-192365a9-feff-4073-ab6c-5fd1ce858338 req-8b8928bb-e17e-42aa-99e3-52a1b493d3a0 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:53 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-192365a9-feff-4073-ab6c-5fd1ce858338 req-8b8928bb-e17e-42aa-99e3-52a1b493d3a0 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:53 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-192365a9-feff-4073-ab6c-5fd1ce858338 req-8b8928bb-e17e-42aa-99e3-52a1b493d3a0 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:53 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-192365a9-feff-4073-ab6c-5fd1ce858338 req-8b8928bb-e17e-42aa-99e3-52a1b493d3a0 service nova] Creating event network-vif-plugged:fb818849-31a0-4c25-b42d-ca19fe250ca6 for instance f6d6085d-9e15-4e29-ab90-3a8928971324 on user Apr 18 16:21:53 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-192365a9-feff-4073-ab6c-5fd1ce858338 req-8b8928bb-e17e-42aa-99e3-52a1b493d3a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033545 Apr 18 16:21:53 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 111/336] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:21:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:21:55 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-498c15ec-3045-4cda-a2ab-6b28e2aaa166 req-815485a7-9cc9-4013-b152-9c96f46a81e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aece7dd-d545-4e26-9cb7-30ee0b01ebb2", "name": "network-vif-plugged", "status": "completed", "tag": "8d71cc71-9d8c-428d-ad04-69a31a967fe9"}, {"server_uuid": "6aece7dd-d545-4e26-9cb7-30ee0b01ebb2", "name": "network-vif-plugged", "status": "completed", "tag": "8d71cc71-9d8c-428d-ad04-69a31a967fe9"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:21:55 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-498c15ec-3045-4cda-a2ab-6b28e2aaa166 req-815485a7-9cc9-4013-b152-9c96f46a81e7 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:55 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-498c15ec-3045-4cda-a2ab-6b28e2aaa166 req-815485a7-9cc9-4013-b152-9c96f46a81e7 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:55 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-498c15ec-3045-4cda-a2ab-6b28e2aaa166 req-815485a7-9cc9-4013-b152-9c96f46a81e7 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:55 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-498c15ec-3045-4cda-a2ab-6b28e2aaa166 req-815485a7-9cc9-4013-b152-9c96f46a81e7 service nova] Creating event network-vif-plugged:8d71cc71-9d8c-428d-ad04-69a31a967fe9 for instance 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 on user Apr 18 16:21:55 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-498c15ec-3045-4cda-a2ab-6b28e2aaa166 req-815485a7-9cc9-4013-b152-9c96f46a81e7 service nova] Creating event network-vif-plugged:8d71cc71-9d8c-428d-ad04-69a31a967fe9 for instance 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 on user Apr 18 16:21:55 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-498c15ec-3045-4cda-a2ab-6b28e2aaa166 req-815485a7-9cc9-4013-b152-9c96f46a81e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029558 Apr 18 16:21:55 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 114/337] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:21:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:21:57 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-388551d7-57b9-46af-88b0-bf1ed62dc49b tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:57 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-388551d7-57b9-46af-88b0-bf1ed62dc49b tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] [instance: 5f4e6f9b-5413-4399-83ca-9bc78911db38] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-388551d7-57b9-46af-88b0-bf1ed62dc49b tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-388551d7-57b9-46af-88b0-bf1ed62dc49b tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-388551d7-57b9-46af-88b0-bf1ed62dc49b tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-388551d7-57b9-46af-88b0-bf1ed62dc49b tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-388551d7-57b9-46af-88b0-bf1ed62dc49b tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:57 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-388551d7-57b9-46af-88b0-bf1ed62dc49b tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:57 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-388551d7-57b9-46af-88b0-bf1ed62dc49b tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01da22d0c8c4ee580567646e279d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '000fb9c948224fe3b595882d36cfb859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:21:57 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-388551d7-57b9-46af-88b0-bf1ed62dc49b tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f4e6f9b-5413-4399-83ca-9bc78911db38" status: 200 len: 1567 microversion: 2.1 time: 0.240942 Apr 18 16:21:57 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 113/338] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:21:57 2023] GET /compute/v2.1/servers/5f4e6f9b-5413-4399-83ca-9bc78911db38 => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:21:58 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-c16c3390-b15a-4e70-b587-e5f1891fc211 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:58 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-c16c3390-b15a-4e70-b587-e5f1891fc211 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:58 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c16c3390-b15a-4e70-b587-e5f1891fc211 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:58 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c16c3390-b15a-4e70-b587-e5f1891fc211 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:58 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c16c3390-b15a-4e70-b587-e5f1891fc211 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:58 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c16c3390-b15a-4e70-b587-e5f1891fc211 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:58 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c16c3390-b15a-4e70-b587-e5f1891fc211 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:58 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c16c3390-b15a-4e70-b587-e5f1891fc211 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:58 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-c16c3390-b15a-4e70-b587-e5f1891fc211 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b7b9d8fdcf42f29e83e755f4f27380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa61b19cc4e4cd4bb7d41291c40ef1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:21:58 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-c16c3390-b15a-4e70-b587-e5f1891fc211 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 200 len: 1658 microversion: 2.1 time: 0.302399 Apr 18 16:21:58 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 112/339] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:21:58 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 1658 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:21:58 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-f5c5c782-2268-4c71-b629-64042e43e389 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:58 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-f5c5c782-2268-4c71-b629-64042e43e389 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] [instance: 5f4e6f9b-5413-4399-83ca-9bc78911db38] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f5c5c782-2268-4c71-b629-64042e43e389 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f5c5c782-2268-4c71-b629-64042e43e389 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f5c5c782-2268-4c71-b629-64042e43e389 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f5c5c782-2268-4c71-b629-64042e43e389 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f5c5c782-2268-4c71-b629-64042e43e389 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-f5c5c782-2268-4c71-b629-64042e43e389 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:58 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-f5c5c782-2268-4c71-b629-64042e43e389 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] [instance: 5f4e6f9b-5413-4399-83ca-9bc78911db38] Going to try to terminate instance {{(pid=61295) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:21:58 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-f5c5c782-2268-4c71-b629-64042e43e389 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5f4e6f9b-5413-4399-83ca-9bc78911db38" status: 204 len: 0 microversion: 2.1 time: 0.112799 Apr 18 16:21:58 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 115/340] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:21:58 2023] DELETE /compute/v2.1/servers/5f4e6f9b-5413-4399-83ca-9bc78911db38 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:21:58 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-88295a98-2ba9-4710-a717-ddf2b671492a tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:21:58 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-88295a98-2ba9-4710-a717-ddf2b671492a tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] [instance: 5f4e6f9b-5413-4399-83ca-9bc78911db38] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:21:58 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-88295a98-2ba9-4710-a717-ddf2b671492a tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:58 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-88295a98-2ba9-4710-a717-ddf2b671492a tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:58 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-88295a98-2ba9-4710-a717-ddf2b671492a tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:58 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-88295a98-2ba9-4710-a717-ddf2b671492a tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:58 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-88295a98-2ba9-4710-a717-ddf2b671492a tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:58 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-88295a98-2ba9-4710-a717-ddf2b671492a tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:59 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-88295a98-2ba9-4710-a717-ddf2b671492a tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b01da22d0c8c4ee580567646e279d7b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '000fb9c948224fe3b595882d36cfb859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:21:59 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-88295a98-2ba9-4710-a717-ddf2b671492a tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f4e6f9b-5413-4399-83ca-9bc78911db38" status: 200 len: 1573 microversion: 2.1 time: 0.219701 Apr 18 16:21:59 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 114/341] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:21:58 2023] GET /compute/v2.1/servers/5f4e6f9b-5413-4399-83ca-9bc78911db38 => generated 1573 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:21:59 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-fb3130b6-0f39-48b9-a019-d7a086f28fa4 req-13e49141-1489-4f0b-978f-6500ec1c9d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f4e6f9b-5413-4399-83ca-9bc78911db38", "name": "network-vif-unplugged", "status": "completed", "tag": "4330b5f4-c990-4a7d-aa5f-f95315fddf78"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:21:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-fb3130b6-0f39-48b9-a019-d7a086f28fa4 req-13e49141-1489-4f0b-978f-6500ec1c9d0e service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:21:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-fb3130b6-0f39-48b9-a019-d7a086f28fa4 req-13e49141-1489-4f0b-978f-6500ec1c9d0e service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:21:59 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-fb3130b6-0f39-48b9-a019-d7a086f28fa4 req-13e49141-1489-4f0b-978f-6500ec1c9d0e service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:21:59 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-fb3130b6-0f39-48b9-a019-d7a086f28fa4 req-13e49141-1489-4f0b-978f-6500ec1c9d0e service nova] Creating event network-vif-unplugged:4330b5f4-c990-4a7d-aa5f-f95315fddf78 for instance 5f4e6f9b-5413-4399-83ca-9bc78911db38 on user Apr 18 16:21:59 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-fb3130b6-0f39-48b9-a019-d7a086f28fa4 req-13e49141-1489-4f0b-978f-6500ec1c9d0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032424 Apr 18 16:21:59 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 113/342] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:21:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:22:00 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-2f602ab9-3c46-4150-99e5-bceb2e533fd5 req-44b4502c-dc69-426d-a5f5-72cf183f27dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f4e6f9b-5413-4399-83ca-9bc78911db38", "name": "network-vif-deleted", "tag": "4330b5f4-c990-4a7d-aa5f-f95315fddf78"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:22:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-2f602ab9-3c46-4150-99e5-bceb2e533fd5 req-44b4502c-dc69-426d-a5f5-72cf183f27dd service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-2f602ab9-3c46-4150-99e5-bceb2e533fd5 req-44b4502c-dc69-426d-a5f5-72cf183f27dd service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-2f602ab9-3c46-4150-99e5-bceb2e533fd5 req-44b4502c-dc69-426d-a5f5-72cf183f27dd service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:00 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-2f602ab9-3c46-4150-99e5-bceb2e533fd5 req-44b4502c-dc69-426d-a5f5-72cf183f27dd service nova] Creating event network-vif-deleted:4330b5f4-c990-4a7d-aa5f-f95315fddf78 for instance 5f4e6f9b-5413-4399-83ca-9bc78911db38 on user Apr 18 16:22:00 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-2f602ab9-3c46-4150-99e5-bceb2e533fd5 req-44b4502c-dc69-426d-a5f5-72cf183f27dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034171 Apr 18 16:22:00 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 116/343] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:22:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:22:01 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-d95c7fc2-0fe8-48dd-9baa-507fd274f82f req-21b144d8-f318-4dc0-9607-ffa29944c45f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f4e6f9b-5413-4399-83ca-9bc78911db38", "name": "network-vif-plugged", "status": "completed", "tag": "4330b5f4-c990-4a7d-aa5f-f95315fddf78"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:22:01 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:01 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=6 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:01 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-d95c7fc2-0fe8-48dd-9baa-507fd274f82f req-21b144d8-f318-4dc0-9607-ffa29944c45f service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:01 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-d95c7fc2-0fe8-48dd-9baa-507fd274f82f req-21b144d8-f318-4dc0-9607-ffa29944c45f service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:01 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-d95c7fc2-0fe8-48dd-9baa-507fd274f82f req-21b144d8-f318-4dc0-9607-ffa29944c45f service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:01 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-d95c7fc2-0fe8-48dd-9baa-507fd274f82f req-21b144d8-f318-4dc0-9607-ffa29944c45f service nova] Creating event network-vif-plugged:4330b5f4-c990-4a7d-aa5f-f95315fddf78 for instance 5f4e6f9b-5413-4399-83ca-9bc78911db38 on user Apr 18 16:22:01 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-d95c7fc2-0fe8-48dd-9baa-507fd274f82f req-21b144d8-f318-4dc0-9607-ffa29944c45f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035290 Apr 18 16:22:01 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 115/344] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:22:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:22:22 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:22 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:22 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:23 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-f07095ea-7fab-43b0-a4e1-4194c092b234 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:23 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-f07095ea-7fab-43b0-a4e1-4194c092b234 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: f5496c5f-292e-4912-991b-f834009e51a1] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:23 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f07095ea-7fab-43b0-a4e1-4194c092b234 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:23 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f07095ea-7fab-43b0-a4e1-4194c092b234 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:23 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f07095ea-7fab-43b0-a4e1-4194c092b234 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:23 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f07095ea-7fab-43b0-a4e1-4194c092b234 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:23 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f07095ea-7fab-43b0-a4e1-4194c092b234 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:23 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-f07095ea-7fab-43b0-a4e1-4194c092b234 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:23 user devstack@n-api.service[61296]: INFO nova.api.openstack.wsgi [None req-f07095ea-7fab-43b0-a4e1-4194c092b234 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] HTTP exception thrown: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. Apr 18 16:22:23 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-f07095ea-7fab-43b0-a4e1-4194c092b234 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Request method failure captured: Apr 18 16:22:23 user devstack@n-api.service[61296]: request: GET /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1 HTTP/1.1 Apr 18 16:22:23 user devstack@n-api.service[61296]: Accept: application/json Apr 18 16:22:23 user devstack@n-api.service[61296]: Accept-Encoding: identity Apr 18 16:22:23 user devstack@n-api.service[61296]: Connection: close Apr 18 16:22:23 user devstack@n-api.service[61296]: Content-Length: 0 Apr 18 16:22:23 user devstack@n-api.service[61296]: Content-Type: application/json Apr 18 16:22:23 user devstack@n-api.service[61296]: Host: 10.0.0.210 Apr 18 16:22:23 user devstack@n-api.service[61296]: Openstack-System-Scope: None Apr 18 16:22:23 user devstack@n-api.service[61296]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:23 user devstack@n-api.service[61296]: X-Auth-Token: gAAAAABkPsJxZZMg8c6qOEThrY-zXDjsOBAG_RG23eHXR2U6SBC8UibggUa2pwtWgol0GRpo6F5Zpj_rEK9ckA0ydlgkbwLbbiMOJLDBmIyfRkUaFf40V_gqv58IzG4Dg3AdkiJCDUpZwqr38KjptayM9UqLuBfDqllHo9u3GkqQAbwfeOU573w Apr 18 16:22:23 user devstack@n-api.service[61296]: X-Domain-Id: None Apr 18 16:22:23 user devstack@n-api.service[61296]: X-Domain-Name: None Apr 18 16:22:23 user devstack@n-api.service[61296]: X-Identity-Status: Confirmed Apr 18 16:22:23 user devstack@n-api.service[61296]: X-Is-Admin-Project: True Apr 18 16:22:23 user devstack@n-api.service[61296]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 16:22:23 user devstack@n-api.service[61296]: X-Project-Domain-Id: default Apr 18 16:22:23 user devstack@n-api.service[61296]: X-Project-Domain-Name: Default Apr 18 16:22:23 user devstack@n-api.service[61296]: X-Project-Id: f9987eeaa6b24ca48e80e8d5318f02ac Apr 18 16:22:23 user devstack@n-api.service[61296]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:22:23 user devstack@n-api.service[61296]: X-Role: reader,member Apr 18 16:22:23 user devstack@n-api.service[61296]: X-Roles: reader,member Apr 18 16:22:23 user devstack@n-api.service[61296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:23 user devstack@n-api.service[61296]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:22:23 user devstack@n-api.service[61296]: X-Tenant-Id: f9987eeaa6b24ca48e80e8d5318f02ac Apr 18 16:22:23 user devstack@n-api.service[61296]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:22:23 user devstack@n-api.service[61296]: X-User: tempest-AttachVolumeShelveTestJSON-1663710151-project-member Apr 18 16:22:23 user devstack@n-api.service[61296]: X-User-Domain-Id: default Apr 18 16:22:23 user devstack@n-api.service[61296]: X-User-Domain-Name: Default Apr 18 16:22:23 user devstack@n-api.service[61296]: X-User-Id: 73a99bbf510f4f67bb7a35901ba3edc5 Apr 18 16:22:23 user devstack@n-api.service[61296]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663710151-project-member Apr 18 16:22:23 user devstack@n-api.service[61296]: method: > Apr 18 16:22:23 user devstack@n-api.service[61296]: exception: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. Apr 18 16:22:23 user devstack@n-api.service[61296]: action_args: {'id': 'f5496c5f-292e-4912-991b-f834009e51a1'} Apr 18 16:22:23 user devstack@n-api.service[61296]: {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. Apr 18 16:22:23 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:23 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-f07095ea-7fab-43b0-a4e1-4194c092b234 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Returning 404 to user: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. {{(pid=61296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:23 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-f07095ea-7fab-43b0-a4e1-4194c092b234 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1" status: 404 len: 111 microversion: 2.20 time: 0.209088 Apr 18 16:22:23 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 114/345] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:22:22 2023] GET /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1 => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 16:22:23 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:23 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:23 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-da898f8e-6b41-4ca6-a4ad-d485900170df tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '.version_select at 0x7fd6c9331cf0>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:23 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-da898f8e-6b41-4ca6-a4ad-d485900170df tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1613556039" status: 204 len: 0 microversion: 2.20 time: 0.031852 Apr 18 16:22:23 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 117/346] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 18 16:22:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1613556039 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=28 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-afde682c-7de8-42d5-831e-7a6b0692c230 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-afde682c-7de8-42d5-831e-7a6b0692c230 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: f5496c5f-292e-4912-991b-f834009e51a1] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-afde682c-7de8-42d5-831e-7a6b0692c230 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-afde682c-7de8-42d5-831e-7a6b0692c230 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-afde682c-7de8-42d5-831e-7a6b0692c230 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-afde682c-7de8-42d5-831e-7a6b0692c230 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-afde682c-7de8-42d5-831e-7a6b0692c230 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-afde682c-7de8-42d5-831e-7a6b0692c230 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:24 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-afde682c-7de8-42d5-831e-7a6b0692c230 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] HTTP exception thrown: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-afde682c-7de8-42d5-831e-7a6b0692c230 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Request method failure captured: Apr 18 16:22:24 user devstack@n-api.service[61294]: request: DELETE /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1 HTTP/1.1 Apr 18 16:22:24 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:22:24 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:22:24 user devstack@n-api.service[61294]: Connection: close Apr 18 16:22:24 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:22:24 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:22:24 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:22:24 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:22:24 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsJxZZMg8c6qOEThrY-zXDjsOBAG_RG23eHXR2U6SBC8UibggUa2pwtWgol0GRpo6F5Zpj_rEK9ckA0ydlgkbwLbbiMOJLDBmIyfRkUaFf40V_gqv58IzG4Dg3AdkiJCDUpZwqr38KjptayM9UqLuBfDqllHo9u3GkqQAbwfeOU573w Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Project-Id: f9987eeaa6b24ca48e80e8d5318f02ac Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Tenant-Id: f9987eeaa6b24ca48e80e8d5318f02ac Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:22:24 user devstack@n-api.service[61294]: X-User: tempest-AttachVolumeShelveTestJSON-1663710151-project-member Apr 18 16:22:24 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:22:24 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:22:24 user devstack@n-api.service[61294]: X-User-Id: 73a99bbf510f4f67bb7a35901ba3edc5 Apr 18 16:22:24 user devstack@n-api.service[61294]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663710151-project-member Apr 18 16:22:24 user devstack@n-api.service[61294]: method: > Apr 18 16:22:24 user devstack@n-api.service[61294]: exception: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61294]: action_args: {'id': 'f5496c5f-292e-4912-991b-f834009e51a1'} Apr 18 16:22:24 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-afde682c-7de8-42d5-831e-7a6b0692c230 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Returning 404 to user: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:24 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-afde682c-7de8-42d5-831e-7a6b0692c230 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1" status: 404 len: 111 microversion: 2.20 time: 0.033908 Apr 18 16:22:24 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 116/347] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 16:22:24 2023] DELETE /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 16:22:24 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-9e65bf33-4758-4a18-8c82-0364d69d5b12 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:24 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-9e65bf33-4758-4a18-8c82-0364d69d5b12 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: f5496c5f-292e-4912-991b-f834009e51a1] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:24 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-9e65bf33-4758-4a18-8c82-0364d69d5b12 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:24 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-9e65bf33-4758-4a18-8c82-0364d69d5b12 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:24 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-9e65bf33-4758-4a18-8c82-0364d69d5b12 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:24 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-9e65bf33-4758-4a18-8c82-0364d69d5b12 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:24 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-9e65bf33-4758-4a18-8c82-0364d69d5b12 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:24 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-9e65bf33-4758-4a18-8c82-0364d69d5b12 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:24 user devstack@n-api.service[61296]: INFO nova.api.openstack.wsgi [None req-9e65bf33-4758-4a18-8c82-0364d69d5b12 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] HTTP exception thrown: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-9e65bf33-4758-4a18-8c82-0364d69d5b12 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Request method failure captured: Apr 18 16:22:24 user devstack@n-api.service[61296]: request: GET /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1 HTTP/1.1 Apr 18 16:22:24 user devstack@n-api.service[61296]: Accept: application/json Apr 18 16:22:24 user devstack@n-api.service[61296]: Accept-Encoding: identity Apr 18 16:22:24 user devstack@n-api.service[61296]: Connection: close Apr 18 16:22:24 user devstack@n-api.service[61296]: Content-Length: 0 Apr 18 16:22:24 user devstack@n-api.service[61296]: Content-Type: application/json Apr 18 16:22:24 user devstack@n-api.service[61296]: Host: 10.0.0.210 Apr 18 16:22:24 user devstack@n-api.service[61296]: Openstack-System-Scope: None Apr 18 16:22:24 user devstack@n-api.service[61296]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:24 user devstack@n-api.service[61296]: X-Auth-Token: gAAAAABkPsJxZZMg8c6qOEThrY-zXDjsOBAG_RG23eHXR2U6SBC8UibggUa2pwtWgol0GRpo6F5Zpj_rEK9ckA0ydlgkbwLbbiMOJLDBmIyfRkUaFf40V_gqv58IzG4Dg3AdkiJCDUpZwqr38KjptayM9UqLuBfDqllHo9u3GkqQAbwfeOU573w Apr 18 16:22:24 user devstack@n-api.service[61296]: X-Domain-Id: None Apr 18 16:22:24 user devstack@n-api.service[61296]: X-Domain-Name: None Apr 18 16:22:24 user devstack@n-api.service[61296]: X-Identity-Status: Confirmed Apr 18 16:22:24 user devstack@n-api.service[61296]: X-Is-Admin-Project: True Apr 18 16:22:24 user devstack@n-api.service[61296]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 16:22:24 user devstack@n-api.service[61296]: X-Project-Domain-Id: default Apr 18 16:22:24 user devstack@n-api.service[61296]: X-Project-Domain-Name: Default Apr 18 16:22:24 user devstack@n-api.service[61296]: X-Project-Id: f9987eeaa6b24ca48e80e8d5318f02ac Apr 18 16:22:24 user devstack@n-api.service[61296]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:22:24 user devstack@n-api.service[61296]: X-Role: reader,member Apr 18 16:22:24 user devstack@n-api.service[61296]: X-Roles: reader,member Apr 18 16:22:24 user devstack@n-api.service[61296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:24 user devstack@n-api.service[61296]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:22:24 user devstack@n-api.service[61296]: X-Tenant-Id: f9987eeaa6b24ca48e80e8d5318f02ac Apr 18 16:22:24 user devstack@n-api.service[61296]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:22:24 user devstack@n-api.service[61296]: X-User: tempest-AttachVolumeShelveTestJSON-1663710151-project-member Apr 18 16:22:24 user devstack@n-api.service[61296]: X-User-Domain-Id: default Apr 18 16:22:24 user devstack@n-api.service[61296]: X-User-Domain-Name: Default Apr 18 16:22:24 user devstack@n-api.service[61296]: X-User-Id: 73a99bbf510f4f67bb7a35901ba3edc5 Apr 18 16:22:24 user devstack@n-api.service[61296]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663710151-project-member Apr 18 16:22:24 user devstack@n-api.service[61296]: method: > Apr 18 16:22:24 user devstack@n-api.service[61296]: exception: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61296]: action_args: {'id': 'f5496c5f-292e-4912-991b-f834009e51a1'} Apr 18 16:22:24 user devstack@n-api.service[61296]: {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-9e65bf33-4758-4a18-8c82-0364d69d5b12 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Returning 404 to user: Instance f5496c5f-292e-4912-991b-f834009e51a1 could not be found. {{(pid=61296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:24 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-9e65bf33-4758-4a18-8c82-0364d69d5b12 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1" status: 404 len: 111 microversion: 2.20 time: 0.027766 Apr 18 16:22:24 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 115/348] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:22:24 2023] GET /compute/v2.1/servers/f5496c5f-292e-4912-991b-f834009e51a1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 16:22:24 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-0d2d3e7d-47d2-4659-ba75-6e0262892fa8 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:24 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-0d2d3e7d-47d2-4659-ba75-6e0262892fa8 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: e32196da-a530-4422-8566-5edb01f3cc62] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:24 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0d2d3e7d-47d2-4659-ba75-6e0262892fa8 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:24 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0d2d3e7d-47d2-4659-ba75-6e0262892fa8 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:24 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0d2d3e7d-47d2-4659-ba75-6e0262892fa8 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:24 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0d2d3e7d-47d2-4659-ba75-6e0262892fa8 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:24 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0d2d3e7d-47d2-4659-ba75-6e0262892fa8 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:24 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0d2d3e7d-47d2-4659-ba75-6e0262892fa8 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:24 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-0d2d3e7d-47d2-4659-ba75-6e0262892fa8 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] HTTP exception thrown: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-0d2d3e7d-47d2-4659-ba75-6e0262892fa8 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Request method failure captured: Apr 18 16:22:24 user devstack@n-api.service[61295]: request: DELETE /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62 HTTP/1.1 Apr 18 16:22:24 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:22:24 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:22:24 user devstack@n-api.service[61295]: Connection: close Apr 18 16:22:24 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:22:24 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:22:24 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:22:24 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:22:24 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:24 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsJxZZMg8c6qOEThrY-zXDjsOBAG_RG23eHXR2U6SBC8UibggUa2pwtWgol0GRpo6F5Zpj_rEK9ckA0ydlgkbwLbbiMOJLDBmIyfRkUaFf40V_gqv58IzG4Dg3AdkiJCDUpZwqr38KjptayM9UqLuBfDqllHo9u3GkqQAbwfeOU573w Apr 18 16:22:24 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:22:24 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:22:24 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:22:24 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:22:24 user devstack@n-api.service[61295]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 16:22:24 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:22:24 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:22:24 user devstack@n-api.service[61295]: X-Project-Id: f9987eeaa6b24ca48e80e8d5318f02ac Apr 18 16:22:24 user devstack@n-api.service[61295]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:22:24 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:22:24 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:22:24 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:24 user devstack@n-api.service[61295]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:22:24 user devstack@n-api.service[61295]: X-Tenant-Id: f9987eeaa6b24ca48e80e8d5318f02ac Apr 18 16:22:24 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:22:24 user devstack@n-api.service[61295]: X-User: tempest-AttachVolumeShelveTestJSON-1663710151-project-member Apr 18 16:22:24 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:22:24 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:22:24 user devstack@n-api.service[61295]: X-User-Id: 73a99bbf510f4f67bb7a35901ba3edc5 Apr 18 16:22:24 user devstack@n-api.service[61295]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663710151-project-member Apr 18 16:22:24 user devstack@n-api.service[61295]: method: > Apr 18 16:22:24 user devstack@n-api.service[61295]: exception: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61295]: action_args: {'id': 'e32196da-a530-4422-8566-5edb01f3cc62'} Apr 18 16:22:24 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-0d2d3e7d-47d2-4659-ba75-6e0262892fa8 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Returning 404 to user: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:24 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-0d2d3e7d-47d2-4659-ba75-6e0262892fa8 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62" status: 404 len: 111 microversion: 2.20 time: 0.030132 Apr 18 16:22:24 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 118/349] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 16:22:24 2023] DELETE /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-6316db9e-b92b-4708-981f-c8bd4068ed32 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-6316db9e-b92b-4708-981f-c8bd4068ed32 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] [instance: e32196da-a530-4422-8566-5edb01f3cc62] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-6316db9e-b92b-4708-981f-c8bd4068ed32 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-6316db9e-b92b-4708-981f-c8bd4068ed32 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-6316db9e-b92b-4708-981f-c8bd4068ed32 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-6316db9e-b92b-4708-981f-c8bd4068ed32 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-6316db9e-b92b-4708-981f-c8bd4068ed32 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-6316db9e-b92b-4708-981f-c8bd4068ed32 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:24 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-6316db9e-b92b-4708-981f-c8bd4068ed32 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] HTTP exception thrown: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-6316db9e-b92b-4708-981f-c8bd4068ed32 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Request method failure captured: Apr 18 16:22:24 user devstack@n-api.service[61294]: request: GET /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62 HTTP/1.1 Apr 18 16:22:24 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:22:24 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:22:24 user devstack@n-api.service[61294]: Connection: close Apr 18 16:22:24 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:22:24 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:22:24 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:22:24 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:22:24 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsJxZZMg8c6qOEThrY-zXDjsOBAG_RG23eHXR2U6SBC8UibggUa2pwtWgol0GRpo6F5Zpj_rEK9ckA0ydlgkbwLbbiMOJLDBmIyfRkUaFf40V_gqv58IzG4Dg3AdkiJCDUpZwqr38KjptayM9UqLuBfDqllHo9u3GkqQAbwfeOU573w Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Project-Id: f9987eeaa6b24ca48e80e8d5318f02ac Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9987eeaa6b24ca48e80e8d5318f02ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Tenant-Id: f9987eeaa6b24ca48e80e8d5318f02ac Apr 18 16:22:24 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663710151 Apr 18 16:22:24 user devstack@n-api.service[61294]: X-User: tempest-AttachVolumeShelveTestJSON-1663710151-project-member Apr 18 16:22:24 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:22:24 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:22:24 user devstack@n-api.service[61294]: X-User-Id: 73a99bbf510f4f67bb7a35901ba3edc5 Apr 18 16:22:24 user devstack@n-api.service[61294]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663710151-project-member Apr 18 16:22:24 user devstack@n-api.service[61294]: method: > Apr 18 16:22:24 user devstack@n-api.service[61294]: exception: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61294]: action_args: {'id': 'e32196da-a530-4422-8566-5edb01f3cc62'} Apr 18 16:22:24 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. Apr 18 16:22:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:24 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-6316db9e-b92b-4708-981f-c8bd4068ed32 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] Returning 404 to user: Instance e32196da-a530-4422-8566-5edb01f3cc62 could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:24 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-6316db9e-b92b-4708-981f-c8bd4068ed32 tempest-AttachVolumeShelveTestJSON-1663710151 tempest-AttachVolumeShelveTestJSON-1663710151-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62" status: 404 len: 111 microversion: 2.20 time: 0.027606 Apr 18 16:22:24 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 117/350] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:22:24 2023] GET /compute/v2.1/servers/e32196da-a530-4422-8566-5edb01f3cc62 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 16:22:33 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-7fbf1da3-a69e-4e59-9913-ba1d79e02b7a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:33 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-7fbf1da3-a69e-4e59-9913-ba1d79e02b7a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] [instance: c16a352d-3f0c-4688-a890-81be1fee9f35] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:33 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7fbf1da3-a69e-4e59-9913-ba1d79e02b7a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:33 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7fbf1da3-a69e-4e59-9913-ba1d79e02b7a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:33 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7fbf1da3-a69e-4e59-9913-ba1d79e02b7a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:33 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7fbf1da3-a69e-4e59-9913-ba1d79e02b7a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:33 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7fbf1da3-a69e-4e59-9913-ba1d79e02b7a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:33 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7fbf1da3-a69e-4e59-9913-ba1d79e02b7a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:33 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-7fbf1da3-a69e-4e59-9913-ba1d79e02b7a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] [instance: c16a352d-3f0c-4688-a890-81be1fee9f35] Going to try to terminate instance {{(pid=61296) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:22:33 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-7fbf1da3-a69e-4e59-9913-ba1d79e02b7a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c16a352d-3f0c-4688-a890-81be1fee9f35" status: 204 len: 0 microversion: 2.1 time: 0.121226 Apr 18 16:22:33 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 116/351] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:22:33 2023] DELETE /compute/v2.1/servers/c16a352d-3f0c-4688-a890-81be1fee9f35 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:22:33 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-59eb8005-ebd6-4042-8fe1-667e633fe5e0 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:33 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-59eb8005-ebd6-4042-8fe1-667e633fe5e0 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] [instance: c16a352d-3f0c-4688-a890-81be1fee9f35] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-59eb8005-ebd6-4042-8fe1-667e633fe5e0 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-59eb8005-ebd6-4042-8fe1-667e633fe5e0 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-59eb8005-ebd6-4042-8fe1-667e633fe5e0 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-59eb8005-ebd6-4042-8fe1-667e633fe5e0 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-59eb8005-ebd6-4042-8fe1-667e633fe5e0 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-59eb8005-ebd6-4042-8fe1-667e633fe5e0 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:34 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-ccf83a26-c122-461b-b534-fb7efec2a9a1 req-9a8ebd8d-661a-46cb-ab2a-3a5208f3d490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c16a352d-3f0c-4688-a890-81be1fee9f35", "name": "network-vif-unplugged", "status": "completed", "tag": "159a1d71-92e3-4ac2-ad79-f530a49580e9"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:22:34 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-59eb8005-ebd6-4042-8fe1-667e633fe5e0 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e222f73f9194870b4fac305cdd60f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb49d5ddf6db4b1d807ba42fd37a919d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:22:34 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-59eb8005-ebd6-4042-8fe1-667e633fe5e0 tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c16a352d-3f0c-4688-a890-81be1fee9f35" status: 200 len: 1492 microversion: 2.1 time: 0.350927 Apr 18 16:22:34 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 119/352] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:22:33 2023] GET /compute/v2.1/servers/c16a352d-3f0c-4688-a890-81be1fee9f35 => generated 1492 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:22:34 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-ccf83a26-c122-461b-b534-fb7efec2a9a1 req-9a8ebd8d-661a-46cb-ab2a-3a5208f3d490 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:34 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-ccf83a26-c122-461b-b534-fb7efec2a9a1 req-9a8ebd8d-661a-46cb-ab2a-3a5208f3d490 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:34 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-ccf83a26-c122-461b-b534-fb7efec2a9a1 req-9a8ebd8d-661a-46cb-ab2a-3a5208f3d490 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:34 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-ccf83a26-c122-461b-b534-fb7efec2a9a1 req-9a8ebd8d-661a-46cb-ab2a-3a5208f3d490 service nova] Creating event network-vif-unplugged:159a1d71-92e3-4ac2-ad79-f530a49580e9 for instance c16a352d-3f0c-4688-a890-81be1fee9f35 on user Apr 18 16:22:34 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-ccf83a26-c122-461b-b534-fb7efec2a9a1 req-9a8ebd8d-661a-46cb-ab2a-3a5208f3d490 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047850 Apr 18 16:22:34 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 118/353] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:22:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:22:35 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-5c5ed526-8739-4770-90e2-4203116ec58c req-ad841434-fde9-4867-884a-cbf1b7088c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c16a352d-3f0c-4688-a890-81be1fee9f35", "name": "network-vif-deleted", "tag": "159a1d71-92e3-4ac2-ad79-f530a49580e9"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:22:35 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-5c5ed526-8739-4770-90e2-4203116ec58c req-ad841434-fde9-4867-884a-cbf1b7088c1e service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:35 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-5c5ed526-8739-4770-90e2-4203116ec58c req-ad841434-fde9-4867-884a-cbf1b7088c1e service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:35 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-5c5ed526-8739-4770-90e2-4203116ec58c req-ad841434-fde9-4867-884a-cbf1b7088c1e service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:35 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-5c5ed526-8739-4770-90e2-4203116ec58c req-ad841434-fde9-4867-884a-cbf1b7088c1e service nova] Creating event network-vif-deleted:159a1d71-92e3-4ac2-ad79-f530a49580e9 for instance c16a352d-3f0c-4688-a890-81be1fee9f35 on user Apr 18 16:22:35 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-5c5ed526-8739-4770-90e2-4203116ec58c req-ad841434-fde9-4867-884a-cbf1b7088c1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032903 Apr 18 16:22:35 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 117/354] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:22:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:22:36 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-b32f23c7-489d-44c9-a3b6-ff5bcecb95d8 req-0568c84f-44a2-4298-94e2-328ab94c90cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c16a352d-3f0c-4688-a890-81be1fee9f35", "name": "network-vif-plugged", "status": "completed", "tag": "159a1d71-92e3-4ac2-ad79-f530a49580e9"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:22:36 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-b32f23c7-489d-44c9-a3b6-ff5bcecb95d8 req-0568c84f-44a2-4298-94e2-328ab94c90cc service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:36 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-b32f23c7-489d-44c9-a3b6-ff5bcecb95d8 req-0568c84f-44a2-4298-94e2-328ab94c90cc service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:36 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-b32f23c7-489d-44c9-a3b6-ff5bcecb95d8 req-0568c84f-44a2-4298-94e2-328ab94c90cc service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:36 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-b32f23c7-489d-44c9-a3b6-ff5bcecb95d8 req-0568c84f-44a2-4298-94e2-328ab94c90cc service nova] Creating event network-vif-plugged:159a1d71-92e3-4ac2-ad79-f530a49580e9 for instance c16a352d-3f0c-4688-a890-81be1fee9f35 on user Apr 18 16:22:36 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-b32f23c7-489d-44c9-a3b6-ff5bcecb95d8 req-0568c84f-44a2-4298-94e2-328ab94c90cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028914 Apr 18 16:22:36 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 120/355] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:22:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:22:40 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-0700ed87-e03d-48ec-b50b-91d3468b4c71 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:40 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-0700ed87-e03d-48ec-b50b-91d3468b4c71 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:40 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0700ed87-e03d-48ec-b50b-91d3468b4c71 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:40 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0700ed87-e03d-48ec-b50b-91d3468b4c71 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:40 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0700ed87-e03d-48ec-b50b-91d3468b4c71 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:40 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0700ed87-e03d-48ec-b50b-91d3468b4c71 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:40 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0700ed87-e03d-48ec-b50b-91d3468b4c71 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:40 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0700ed87-e03d-48ec-b50b-91d3468b4c71 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:40 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-0700ed87-e03d-48ec-b50b-91d3468b4c71 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:22:40 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-0700ed87-e03d-48ec-b50b-91d3468b4c71 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:22:40 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-0700ed87-e03d-48ec-b50b-91d3468b4c71 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:22:40 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-0700ed87-e03d-48ec-b50b-91d3468b4c71 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6aece7dd-d545-4e26-9cb7-30ee0b01ebb2" status: 200 len: 1691 microversion: 2.87 time: 0.281288 Apr 18 16:22:40 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 119/356] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:22:40 2023] GET /compute/v2.1/servers/6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 => generated 1691 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:22:41 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1167960863", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "networks": [{"uuid": "236fa8aa-433b-4dfa-a787-f165c3389489"}]}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:22:41 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-4f4e9dde-f49d-4654-95df-0565032f59c7 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:41 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-4f4e9dde-f49d-4654-95df-0565032f59c7 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f6d6085d-9e15-4e29-ab90-3a8928971324] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4f4e9dde-f49d-4654-95df-0565032f59c7 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4f4e9dde-f49d-4654-95df-0565032f59c7 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4f4e9dde-f49d-4654-95df-0565032f59c7 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4f4e9dde-f49d-4654-95df-0565032f59c7 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4f4e9dde-f49d-4654-95df-0565032f59c7 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4f4e9dde-f49d-4654-95df-0565032f59c7 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:41 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-4f4e9dde-f49d-4654-95df-0565032f59c7 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] HTTP exception thrown: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. Apr 18 16:22:41 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-4f4e9dde-f49d-4654-95df-0565032f59c7 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Request method failure captured: Apr 18 16:22:41 user devstack@n-api.service[61295]: request: GET /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324 HTTP/1.1 Apr 18 16:22:41 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:22:41 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:22:41 user devstack@n-api.service[61295]: Connection: close Apr 18 16:22:41 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:22:41 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:22:41 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:22:41 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:22:41 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:41 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsHTZ7piGp01Yhd4R65i1j6b1tm_mMC4UdZnSeVxAUqrjcgOgLCuqXk0nrLp3WWbo5cJrYSMAj1QaNQisCM4wiIgBJFWpK96pq4PU3dacvENZhQvIWTlb95XqutwUJW_QMqFtqglLPmnY7p8o40n_yxwAZ-6Her-cOHvYNFFN0lubNw Apr 18 16:22:41 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:22:41 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:22:41 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:22:41 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:22:41 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:22:41 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:22:41 user devstack@n-api.service[61295]: X-Project-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:22:41 user devstack@n-api.service[61295]: X-Project-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:41 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:22:41 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:22:41 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:41 user devstack@n-api.service[61295]: X-Tenant: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:41 user devstack@n-api.service[61295]: X-Tenant-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:22:41 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:41 user devstack@n-api.service[61295]: X-User: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:22:41 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:22:41 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:22:41 user devstack@n-api.service[61295]: X-User-Id: af90e17ec027463fa8793e8539c39e13 Apr 18 16:22:41 user devstack@n-api.service[61295]: X-User-Name: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:22:41 user devstack@n-api.service[61295]: method: > Apr 18 16:22:41 user devstack@n-api.service[61295]: exception: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. Apr 18 16:22:41 user devstack@n-api.service[61295]: action_args: {'id': 'f6d6085d-9e15-4e29-ab90-3a8928971324'} Apr 18 16:22:41 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. Apr 18 16:22:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:41 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-4f4e9dde-f49d-4654-95df-0565032f59c7 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Returning 404 to user: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:41 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-4f4e9dde-f49d-4654-95df-0565032f59c7 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324" status: 404 len: 111 microversion: 2.1 time: 0.032240 Apr 18 16:22:41 user devstack@n-api.service[61296]: DEBUG nova.network.neutron [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] validate_networks() for [('236fa8aa-433b-4dfa-a787-f165c3389489', None, None, None, None, None)] {{(pid=61296) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:22:41 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 121/357] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:22:41 2023] GET /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:22:41 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-5d0a66ef-5b1d-4d81-ab62-4a1fbad2d8ba tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '.version_select at 0x7fd6c94e1ab0>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:41 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-5d0a66ef-5b1d-4d81-ab62-4a1fbad2d8ba tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-901960884" status: 202 len: 0 microversion: 2.1 time: 0.022895 Apr 18 16:22:41 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 120/358] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 16:22:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-901960884 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Flavor limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Image limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Flavor pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Image pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Getting quotas for project 5695adbb14ea4162bc40547b1509a1e4. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Getting quotas for user 2963911de4f34d79816a9a1f9ad24a27 and project 5695adbb14ea4162bc40547b1509a1e4. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:22:42 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-8965cb57-3dec-4462-ba42-ac66833be876 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:42 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-8965cb57-3dec-4462-ba42-ac66833be876 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f6d6085d-9e15-4e29-ab90-3a8928971324] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:42 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8965cb57-3dec-4462-ba42-ac66833be876 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Going to run 1 instances... {{(pid=61296) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:22:42 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8965cb57-3dec-4462-ba42-ac66833be876 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:42 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8965cb57-3dec-4462-ba42-ac66833be876 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:42 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8965cb57-3dec-4462-ba42-ac66833be876 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:42 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8965cb57-3dec-4462-ba42-ac66833be876 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:42 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8965cb57-3dec-4462-ba42-ac66833be876 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: a4febff2-74e8-47ef-820d-f407a4d22d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:22:42 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-8965cb57-3dec-4462-ba42-ac66833be876 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] HTTP exception thrown: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. Apr 18 16:22:42 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-8965cb57-3dec-4462-ba42-ac66833be876 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Request method failure captured: Apr 18 16:22:42 user devstack@n-api.service[61295]: request: DELETE /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324 HTTP/1.1 Apr 18 16:22:42 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:22:42 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:22:42 user devstack@n-api.service[61295]: Connection: close Apr 18 16:22:42 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:22:42 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:22:42 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:22:42 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:22:42 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:42 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsHTZ7piGp01Yhd4R65i1j6b1tm_mMC4UdZnSeVxAUqrjcgOgLCuqXk0nrLp3WWbo5cJrYSMAj1QaNQisCM4wiIgBJFWpK96pq4PU3dacvENZhQvIWTlb95XqutwUJW_QMqFtqglLPmnY7p8o40n_yxwAZ-6Her-cOHvYNFFN0lubNw Apr 18 16:22:42 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:22:42 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:22:42 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:22:42 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:22:42 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:22:42 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:22:42 user devstack@n-api.service[61295]: X-Project-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:22:42 user devstack@n-api.service[61295]: X-Project-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:42 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:22:42 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:22:42 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:42 user devstack@n-api.service[61295]: X-Tenant: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:42 user devstack@n-api.service[61295]: X-Tenant-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:22:42 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:42 user devstack@n-api.service[61295]: X-User: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:22:42 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:22:42 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:22:42 user devstack@n-api.service[61295]: X-User-Id: af90e17ec027463fa8793e8539c39e13 Apr 18 16:22:42 user devstack@n-api.service[61295]: X-User-Name: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:22:42 user devstack@n-api.service[61295]: method: > Apr 18 16:22:42 user devstack@n-api.service[61295]: exception: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. Apr 18 16:22:42 user devstack@n-api.service[61295]: action_args: {'id': 'f6d6085d-9e15-4e29-ab90-3a8928971324'} Apr 18 16:22:42 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. Apr 18 16:22:42 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-8965cb57-3dec-4462-ba42-ac66833be876 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Returning 404 to user: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:42 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-8965cb57-3dec-4462-ba42-ac66833be876 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324" status: 404 len: 111 microversion: 2.1 time: 0.028204 Apr 18 16:22:42 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 122/359] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:22:42 2023] DELETE /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-203b9cd0-811a-4463-ac7f-11555b1ca21d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-203b9cd0-811a-4463-ac7f-11555b1ca21d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f6d6085d-9e15-4e29-ab90-3a8928971324] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-203b9cd0-811a-4463-ac7f-11555b1ca21d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-203b9cd0-811a-4463-ac7f-11555b1ca21d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-203b9cd0-811a-4463-ac7f-11555b1ca21d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-203b9cd0-811a-4463-ac7f-11555b1ca21d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-203b9cd0-811a-4463-ac7f-11555b1ca21d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-203b9cd0-811a-4463-ac7f-11555b1ca21d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:42 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-bba57677-8b4a-45e0-b074-ac345bb3e2ee tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.894978 Apr 18 16:22:42 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 118/360] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:22:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:22:42 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-203b9cd0-811a-4463-ac7f-11555b1ca21d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] HTTP exception thrown: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-203b9cd0-811a-4463-ac7f-11555b1ca21d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Request method failure captured: Apr 18 16:22:42 user devstack@n-api.service[61294]: request: GET /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324 HTTP/1.1 Apr 18 16:22:42 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:22:42 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:22:42 user devstack@n-api.service[61294]: Connection: close Apr 18 16:22:42 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:22:42 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:22:42 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:22:42 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:22:42 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsHTZ7piGp01Yhd4R65i1j6b1tm_mMC4UdZnSeVxAUqrjcgOgLCuqXk0nrLp3WWbo5cJrYSMAj1QaNQisCM4wiIgBJFWpK96pq4PU3dacvENZhQvIWTlb95XqutwUJW_QMqFtqglLPmnY7p8o40n_yxwAZ-6Her-cOHvYNFFN0lubNw Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Project-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Project-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Tenant: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Tenant-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:42 user devstack@n-api.service[61294]: X-User: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:22:42 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:22:42 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:22:42 user devstack@n-api.service[61294]: X-User-Id: af90e17ec027463fa8793e8539c39e13 Apr 18 16:22:42 user devstack@n-api.service[61294]: X-User-Name: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:22:42 user devstack@n-api.service[61294]: method: > Apr 18 16:22:42 user devstack@n-api.service[61294]: exception: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. Apr 18 16:22:42 user devstack@n-api.service[61294]: action_args: {'id': 'f6d6085d-9e15-4e29-ab90-3a8928971324'} Apr 18 16:22:42 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-53a91559-35b6-4f28-81b5-0497954eec06 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:42 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-53a91559-35b6-4f28-81b5-0497954eec06 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: a4febff2-74e8-47ef-820d-f407a4d22d9d] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-203b9cd0-811a-4463-ac7f-11555b1ca21d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Returning 404 to user: Instance f6d6085d-9e15-4e29-ab90-3a8928971324 could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:42 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-203b9cd0-811a-4463-ac7f-11555b1ca21d tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324" status: 404 len: 111 microversion: 2.1 time: 0.036462 Apr 18 16:22:42 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 121/361] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:22:42 2023] GET /compute/v2.1/servers/f6d6085d-9e15-4e29-ab90-3a8928971324 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:22:42 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-53a91559-35b6-4f28-81b5-0497954eec06 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2963911de4f34d79816a9a1f9ad24a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5695adbb14ea4162bc40547b1509a1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:22:42 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-53a91559-35b6-4f28-81b5-0497954eec06 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d" status: 200 len: 1211 microversion: 2.1 time: 0.073026 Apr 18 16:22:42 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 123/362] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:22:42 2023] GET /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d => generated 1211 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-8740e5d3-62cd-44d8-a3cc-781c32fbdc9c tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-8740e5d3-62cd-44d8-a3cc-781c32fbdc9c tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-8740e5d3-62cd-44d8-a3cc-781c32fbdc9c tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-8740e5d3-62cd-44d8-a3cc-781c32fbdc9c tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-8740e5d3-62cd-44d8-a3cc-781c32fbdc9c tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-8740e5d3-62cd-44d8-a3cc-781c32fbdc9c tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-8740e5d3-62cd-44d8-a3cc-781c32fbdc9c tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-8740e5d3-62cd-44d8-a3cc-781c32fbdc9c tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:42 user devstack@n-api.service[61296]: INFO nova.api.openstack.wsgi [None req-8740e5d3-62cd-44d8-a3cc-781c32fbdc9c tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] HTTP exception thrown: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-8740e5d3-62cd-44d8-a3cc-781c32fbdc9c tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Request method failure captured: Apr 18 16:22:42 user devstack@n-api.service[61296]: request: DELETE /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc HTTP/1.1 Apr 18 16:22:42 user devstack@n-api.service[61296]: Accept: application/json Apr 18 16:22:42 user devstack@n-api.service[61296]: Accept-Encoding: identity Apr 18 16:22:42 user devstack@n-api.service[61296]: Connection: close Apr 18 16:22:42 user devstack@n-api.service[61296]: Content-Length: 0 Apr 18 16:22:42 user devstack@n-api.service[61296]: Content-Type: application/json Apr 18 16:22:42 user devstack@n-api.service[61296]: Host: 10.0.0.210 Apr 18 16:22:42 user devstack@n-api.service[61296]: Openstack-System-Scope: None Apr 18 16:22:42 user devstack@n-api.service[61296]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:42 user devstack@n-api.service[61296]: X-Auth-Token: gAAAAABkPsHTZ7piGp01Yhd4R65i1j6b1tm_mMC4UdZnSeVxAUqrjcgOgLCuqXk0nrLp3WWbo5cJrYSMAj1QaNQisCM4wiIgBJFWpK96pq4PU3dacvENZhQvIWTlb95XqutwUJW_QMqFtqglLPmnY7p8o40n_yxwAZ-6Her-cOHvYNFFN0lubNw Apr 18 16:22:42 user devstack@n-api.service[61296]: X-Domain-Id: None Apr 18 16:22:42 user devstack@n-api.service[61296]: X-Domain-Name: None Apr 18 16:22:42 user devstack@n-api.service[61296]: X-Identity-Status: Confirmed Apr 18 16:22:42 user devstack@n-api.service[61296]: X-Is-Admin-Project: True Apr 18 16:22:42 user devstack@n-api.service[61296]: X-Project-Domain-Id: default Apr 18 16:22:42 user devstack@n-api.service[61296]: X-Project-Domain-Name: Default Apr 18 16:22:42 user devstack@n-api.service[61296]: X-Project-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:22:42 user devstack@n-api.service[61296]: X-Project-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:42 user devstack@n-api.service[61296]: X-Role: reader,member Apr 18 16:22:42 user devstack@n-api.service[61296]: X-Roles: reader,member Apr 18 16:22:42 user devstack@n-api.service[61296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:42 user devstack@n-api.service[61296]: X-Tenant: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:42 user devstack@n-api.service[61296]: X-Tenant-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:22:42 user devstack@n-api.service[61296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:42 user devstack@n-api.service[61296]: X-User: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:22:42 user devstack@n-api.service[61296]: X-User-Domain-Id: default Apr 18 16:22:42 user devstack@n-api.service[61296]: X-User-Domain-Name: Default Apr 18 16:22:42 user devstack@n-api.service[61296]: X-User-Id: af90e17ec027463fa8793e8539c39e13 Apr 18 16:22:42 user devstack@n-api.service[61296]: X-User-Name: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:22:42 user devstack@n-api.service[61296]: method: > Apr 18 16:22:42 user devstack@n-api.service[61296]: exception: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. Apr 18 16:22:42 user devstack@n-api.service[61296]: action_args: {'id': 'f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc'} Apr 18 16:22:42 user devstack@n-api.service[61296]: {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. Apr 18 16:22:42 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-8740e5d3-62cd-44d8-a3cc-781c32fbdc9c tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Returning 404 to user: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. {{(pid=61296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:42 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-8740e5d3-62cd-44d8-a3cc-781c32fbdc9c tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc" status: 404 len: 111 microversion: 2.1 time: 0.028561 Apr 18 16:22:42 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 119/363] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:22:42 2023] DELETE /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-5ca40fb3-6eed-4ca3-ae45-d9b52d8894e5 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-5ca40fb3-6eed-4ca3-ae45-d9b52d8894e5 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5ca40fb3-6eed-4ca3-ae45-d9b52d8894e5 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5ca40fb3-6eed-4ca3-ae45-d9b52d8894e5 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5ca40fb3-6eed-4ca3-ae45-d9b52d8894e5 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5ca40fb3-6eed-4ca3-ae45-d9b52d8894e5 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5ca40fb3-6eed-4ca3-ae45-d9b52d8894e5 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5ca40fb3-6eed-4ca3-ae45-d9b52d8894e5 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:42 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-5ca40fb3-6eed-4ca3-ae45-d9b52d8894e5 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] HTTP exception thrown: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-5ca40fb3-6eed-4ca3-ae45-d9b52d8894e5 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Request method failure captured: Apr 18 16:22:42 user devstack@n-api.service[61294]: request: GET /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc HTTP/1.1 Apr 18 16:22:42 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:22:42 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:22:42 user devstack@n-api.service[61294]: Connection: close Apr 18 16:22:42 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:22:42 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:22:42 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:22:42 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:22:42 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsHTZ7piGp01Yhd4R65i1j6b1tm_mMC4UdZnSeVxAUqrjcgOgLCuqXk0nrLp3WWbo5cJrYSMAj1QaNQisCM4wiIgBJFWpK96pq4PU3dacvENZhQvIWTlb95XqutwUJW_QMqFtqglLPmnY7p8o40n_yxwAZ-6Her-cOHvYNFFN0lubNw Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Project-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Project-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Tenant: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Tenant-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:22:42 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:42 user devstack@n-api.service[61294]: X-User: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:22:42 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:22:42 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:22:42 user devstack@n-api.service[61294]: X-User-Id: af90e17ec027463fa8793e8539c39e13 Apr 18 16:22:42 user devstack@n-api.service[61294]: X-User-Name: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:22:42 user devstack@n-api.service[61294]: method: > Apr 18 16:22:42 user devstack@n-api.service[61294]: exception: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. Apr 18 16:22:42 user devstack@n-api.service[61294]: action_args: {'id': 'f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc'} Apr 18 16:22:42 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. Apr 18 16:22:42 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:42 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-5ca40fb3-6eed-4ca3-ae45-d9b52d8894e5 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Returning 404 to user: Instance f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:42 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-5ca40fb3-6eed-4ca3-ae45-d9b52d8894e5 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc" status: 404 len: 111 microversion: 2.1 time: 0.030515 Apr 18 16:22:42 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 122/364] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:22:42 2023] GET /compute/v2.1/servers/f39eb5ec-4b8d-4ff7-8b47-aa1c34cfa3cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:22:43 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-33a1a7ce-c5da-41ed-a7e4-cc72f76fa4ff tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:43 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-33a1a7ce-c5da-41ed-a7e4-cc72f76fa4ff tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: 993d062c-8462-4534-bcde-9249779d4e90] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:43 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-33a1a7ce-c5da-41ed-a7e4-cc72f76fa4ff tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:43 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-33a1a7ce-c5da-41ed-a7e4-cc72f76fa4ff tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:43 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-33a1a7ce-c5da-41ed-a7e4-cc72f76fa4ff tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:43 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-33a1a7ce-c5da-41ed-a7e4-cc72f76fa4ff tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:43 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-33a1a7ce-c5da-41ed-a7e4-cc72f76fa4ff tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:43 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-33a1a7ce-c5da-41ed-a7e4-cc72f76fa4ff tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:43 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-33a1a7ce-c5da-41ed-a7e4-cc72f76fa4ff tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] HTTP exception thrown: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. Apr 18 16:22:43 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-33a1a7ce-c5da-41ed-a7e4-cc72f76fa4ff tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Request method failure captured: Apr 18 16:22:43 user devstack@n-api.service[61295]: request: DELETE /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90 HTTP/1.1 Apr 18 16:22:43 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:22:43 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:22:43 user devstack@n-api.service[61295]: Connection: close Apr 18 16:22:43 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:22:43 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:22:43 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:22:43 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:22:43 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:43 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsHTZ7piGp01Yhd4R65i1j6b1tm_mMC4UdZnSeVxAUqrjcgOgLCuqXk0nrLp3WWbo5cJrYSMAj1QaNQisCM4wiIgBJFWpK96pq4PU3dacvENZhQvIWTlb95XqutwUJW_QMqFtqglLPmnY7p8o40n_yxwAZ-6Her-cOHvYNFFN0lubNw Apr 18 16:22:43 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:22:43 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:22:43 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:22:43 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:22:43 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:22:43 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:22:43 user devstack@n-api.service[61295]: X-Project-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:22:43 user devstack@n-api.service[61295]: X-Project-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:43 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:22:43 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:22:43 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:43 user devstack@n-api.service[61295]: X-Tenant: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:43 user devstack@n-api.service[61295]: X-Tenant-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:22:43 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:43 user devstack@n-api.service[61295]: X-User: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:22:43 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:22:43 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:22:43 user devstack@n-api.service[61295]: X-User-Id: af90e17ec027463fa8793e8539c39e13 Apr 18 16:22:43 user devstack@n-api.service[61295]: X-User-Name: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:22:43 user devstack@n-api.service[61295]: method: > Apr 18 16:22:43 user devstack@n-api.service[61295]: exception: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. Apr 18 16:22:43 user devstack@n-api.service[61295]: action_args: {'id': '993d062c-8462-4534-bcde-9249779d4e90'} Apr 18 16:22:43 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. Apr 18 16:22:43 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:43 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-33a1a7ce-c5da-41ed-a7e4-cc72f76fa4ff tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Returning 404 to user: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:43 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-33a1a7ce-c5da-41ed-a7e4-cc72f76fa4ff tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90" status: 404 len: 111 microversion: 2.1 time: 0.035722 Apr 18 16:22:43 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 124/365] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:22:43 2023] DELETE /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:22:43 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-7b0baf64-296d-4715-a062-5bdec506ce54 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:43 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-7b0baf64-296d-4715-a062-5bdec506ce54 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] [instance: 993d062c-8462-4534-bcde-9249779d4e90] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:43 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7b0baf64-296d-4715-a062-5bdec506ce54 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:43 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7b0baf64-296d-4715-a062-5bdec506ce54 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:43 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7b0baf64-296d-4715-a062-5bdec506ce54 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:43 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7b0baf64-296d-4715-a062-5bdec506ce54 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:43 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7b0baf64-296d-4715-a062-5bdec506ce54 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:43 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7b0baf64-296d-4715-a062-5bdec506ce54 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:43 user devstack@n-api.service[61296]: INFO nova.api.openstack.wsgi [None req-7b0baf64-296d-4715-a062-5bdec506ce54 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] HTTP exception thrown: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. Apr 18 16:22:43 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-7b0baf64-296d-4715-a062-5bdec506ce54 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Request method failure captured: Apr 18 16:22:43 user devstack@n-api.service[61296]: request: GET /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90 HTTP/1.1 Apr 18 16:22:43 user devstack@n-api.service[61296]: Accept: application/json Apr 18 16:22:43 user devstack@n-api.service[61296]: Accept-Encoding: identity Apr 18 16:22:43 user devstack@n-api.service[61296]: Connection: close Apr 18 16:22:43 user devstack@n-api.service[61296]: Content-Length: 0 Apr 18 16:22:43 user devstack@n-api.service[61296]: Content-Type: application/json Apr 18 16:22:43 user devstack@n-api.service[61296]: Host: 10.0.0.210 Apr 18 16:22:43 user devstack@n-api.service[61296]: Openstack-System-Scope: None Apr 18 16:22:43 user devstack@n-api.service[61296]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:43 user devstack@n-api.service[61296]: X-Auth-Token: gAAAAABkPsHTZ7piGp01Yhd4R65i1j6b1tm_mMC4UdZnSeVxAUqrjcgOgLCuqXk0nrLp3WWbo5cJrYSMAj1QaNQisCM4wiIgBJFWpK96pq4PU3dacvENZhQvIWTlb95XqutwUJW_QMqFtqglLPmnY7p8o40n_yxwAZ-6Her-cOHvYNFFN0lubNw Apr 18 16:22:43 user devstack@n-api.service[61296]: X-Domain-Id: None Apr 18 16:22:43 user devstack@n-api.service[61296]: X-Domain-Name: None Apr 18 16:22:43 user devstack@n-api.service[61296]: X-Identity-Status: Confirmed Apr 18 16:22:43 user devstack@n-api.service[61296]: X-Is-Admin-Project: True Apr 18 16:22:43 user devstack@n-api.service[61296]: X-Project-Domain-Id: default Apr 18 16:22:43 user devstack@n-api.service[61296]: X-Project-Domain-Name: Default Apr 18 16:22:43 user devstack@n-api.service[61296]: X-Project-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:22:43 user devstack@n-api.service[61296]: X-Project-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:43 user devstack@n-api.service[61296]: X-Role: reader,member Apr 18 16:22:43 user devstack@n-api.service[61296]: X-Roles: reader,member Apr 18 16:22:43 user devstack@n-api.service[61296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6b4e8d8797be4c0e91b1401538f2eba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:43 user devstack@n-api.service[61296]: X-Tenant: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:43 user devstack@n-api.service[61296]: X-Tenant-Id: 6b4e8d8797be4c0e91b1401538f2eba8 Apr 18 16:22:43 user devstack@n-api.service[61296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-216357456 Apr 18 16:22:43 user devstack@n-api.service[61296]: X-User: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:22:43 user devstack@n-api.service[61296]: X-User-Domain-Id: default Apr 18 16:22:43 user devstack@n-api.service[61296]: X-User-Domain-Name: Default Apr 18 16:22:43 user devstack@n-api.service[61296]: X-User-Id: af90e17ec027463fa8793e8539c39e13 Apr 18 16:22:43 user devstack@n-api.service[61296]: X-User-Name: tempest-AttachVolumeNegativeTest-216357456-project-member Apr 18 16:22:43 user devstack@n-api.service[61296]: method: > Apr 18 16:22:43 user devstack@n-api.service[61296]: exception: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. Apr 18 16:22:43 user devstack@n-api.service[61296]: action_args: {'id': '993d062c-8462-4534-bcde-9249779d4e90'} Apr 18 16:22:43 user devstack@n-api.service[61296]: {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. Apr 18 16:22:43 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:43 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-7b0baf64-296d-4715-a062-5bdec506ce54 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] Returning 404 to user: Instance 993d062c-8462-4534-bcde-9249779d4e90 could not be found. {{(pid=61296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:43 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-7b0baf64-296d-4715-a062-5bdec506ce54 tempest-AttachVolumeNegativeTest-216357456 tempest-AttachVolumeNegativeTest-216357456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90" status: 404 len: 111 microversion: 2.1 time: 0.029907 Apr 18 16:22:43 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 120/366] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:22:43 2023] GET /compute/v2.1/servers/993d062c-8462-4534-bcde-9249779d4e90 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:22:45 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-1fd51e38-cf5b-4ae3-a560-52260b286367 req-917ffe90-f630-4728-a7bc-860bf6650e8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4febff2-74e8-47ef-820d-f407a4d22d9d", "tag": "5e7e767e-18ff-4103-8ea8-ce2a0375d42e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:22:45 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-1fd51e38-cf5b-4ae3-a560-52260b286367 req-917ffe90-f630-4728-a7bc-860bf6650e8f service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:45 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-1fd51e38-cf5b-4ae3-a560-52260b286367 req-917ffe90-f630-4728-a7bc-860bf6650e8f service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:45 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-1fd51e38-cf5b-4ae3-a560-52260b286367 req-917ffe90-f630-4728-a7bc-860bf6650e8f service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:45 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-1fd51e38-cf5b-4ae3-a560-52260b286367 req-917ffe90-f630-4728-a7bc-860bf6650e8f service nova] Creating event network-changed:5e7e767e-18ff-4103-8ea8-ce2a0375d42e for instance a4febff2-74e8-47ef-820d-f407a4d22d9d on user Apr 18 16:22:45 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-1fd51e38-cf5b-4ae3-a560-52260b286367 req-917ffe90-f630-4728-a7bc-860bf6650e8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040370 Apr 18 16:22:45 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 123/367] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:22:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:22:47 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-831893f0-d4bc-4273-b2da-53b1b3f07c2a tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Action: 'create', calling method: .version_select at 0x7fd6c9331750>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-420453222", "metadata": {"Type": "work"}}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:22:47 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-831893f0-d4bc-4273-b2da-53b1b3f07c2a tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Request method failure captured: Apr 18 16:22:47 user devstack@n-api.service[61295]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 16:22:47 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:22:47 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:22:47 user devstack@n-api.service[61295]: Connection: close Apr 18 16:22:47 user devstack@n-api.service[61295]: Content-Length: 121 Apr 18 16:22:47 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:22:47 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:22:47 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:22:47 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsPXOb7JB7YyUXghWPCDyWmCG4_dbIgvCiCPUb_InM9Dm8e6-sCLuMaGKGMKTEqaJkjbmcQ7KtZr01FIFfHHFw4zvExEHudiXvQeo-oR4aJPJxLjrtIBz2FZvy4Bwunjj-Pmz3srS4SMA9J5ohZmw6-n-lPj5ob5KvjZF76CmPGNJR0 Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Project-Id: 65096a70d3784ab7aeb6c5caace078e3 Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Project-Name: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Tenant: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Tenant-Id: 65096a70d3784ab7aeb6c5caace078e3 Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:47 user devstack@n-api.service[61295]: X-User: tempest-VolumesNegativeTest-1284769613-project-member Apr 18 16:22:47 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:22:47 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:22:47 user devstack@n-api.service[61295]: X-User-Id: 20a61b556175475c884c6c3109558c4c Apr 18 16:22:47 user devstack@n-api.service[61295]: X-User-Name: tempest-VolumesNegativeTest-1284769613-project-member Apr 18 16:22:47 user devstack@n-api.service[61295]: Apr 18 16:22:47 user devstack@n-api.service[61295]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-420453222", "metadata": {"Type": "work"}}} Apr 18 16:22:47 user devstack@n-api.service[61295]: method: Apr 18 16:22:47 user devstack@n-api.service[61295]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 16:22:47 user devstack@n-api.service[61295]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-420453222', 'metadata': {'Type': 'work'}}}} Apr 18 16:22:47 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise error Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi '#$%' Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-831893f0-d4bc-4273-b2da-53b1b3f07c2a tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:47 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-831893f0-d4bc-4273-b2da-53b1b3f07c2a tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.208267 Apr 18 16:22:47 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 125/368] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 16:22:47 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 16:22:47 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-917b27f3-9b72-4a00-a040-39f57e02bf7f tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Action: 'create', calling method: .version_select at 0x7fd6c9243250>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1649199802", "metadata": {"Type": "work"}}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:22:47 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-917b27f3-9b72-4a00-a040-39f57e02bf7f tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Request method failure captured: Apr 18 16:22:47 user devstack@n-api.service[61296]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 16:22:47 user devstack@n-api.service[61296]: Accept: application/json Apr 18 16:22:47 user devstack@n-api.service[61296]: Accept-Encoding: identity Apr 18 16:22:47 user devstack@n-api.service[61296]: Connection: close Apr 18 16:22:47 user devstack@n-api.service[61296]: Content-Length: 120 Apr 18 16:22:47 user devstack@n-api.service[61296]: Content-Type: application/json Apr 18 16:22:47 user devstack@n-api.service[61296]: Host: 10.0.0.210 Apr 18 16:22:47 user devstack@n-api.service[61296]: Openstack-System-Scope: None Apr 18 16:22:47 user devstack@n-api.service[61296]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:47 user devstack@n-api.service[61296]: X-Auth-Token: gAAAAABkPsPXOb7JB7YyUXghWPCDyWmCG4_dbIgvCiCPUb_InM9Dm8e6-sCLuMaGKGMKTEqaJkjbmcQ7KtZr01FIFfHHFw4zvExEHudiXvQeo-oR4aJPJxLjrtIBz2FZvy4Bwunjj-Pmz3srS4SMA9J5ohZmw6-n-lPj5ob5KvjZF76CmPGNJR0 Apr 18 16:22:47 user devstack@n-api.service[61296]: X-Domain-Id: None Apr 18 16:22:47 user devstack@n-api.service[61296]: X-Domain-Name: None Apr 18 16:22:47 user devstack@n-api.service[61296]: X-Identity-Status: Confirmed Apr 18 16:22:47 user devstack@n-api.service[61296]: X-Is-Admin-Project: True Apr 18 16:22:47 user devstack@n-api.service[61296]: X-Project-Domain-Id: default Apr 18 16:22:47 user devstack@n-api.service[61296]: X-Project-Domain-Name: Default Apr 18 16:22:47 user devstack@n-api.service[61296]: X-Project-Id: 65096a70d3784ab7aeb6c5caace078e3 Apr 18 16:22:47 user devstack@n-api.service[61296]: X-Project-Name: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:47 user devstack@n-api.service[61296]: X-Role: reader,member Apr 18 16:22:47 user devstack@n-api.service[61296]: X-Roles: reader,member Apr 18 16:22:47 user devstack@n-api.service[61296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:47 user devstack@n-api.service[61296]: X-Tenant: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:47 user devstack@n-api.service[61296]: X-Tenant-Id: 65096a70d3784ab7aeb6c5caace078e3 Apr 18 16:22:47 user devstack@n-api.service[61296]: X-Tenant-Name: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:47 user devstack@n-api.service[61296]: X-User: tempest-VolumesNegativeTest-1284769613-project-member Apr 18 16:22:47 user devstack@n-api.service[61296]: X-User-Domain-Id: default Apr 18 16:22:47 user devstack@n-api.service[61296]: X-User-Domain-Name: Default Apr 18 16:22:47 user devstack@n-api.service[61296]: X-User-Id: 20a61b556175475c884c6c3109558c4c Apr 18 16:22:47 user devstack@n-api.service[61296]: X-User-Name: tempest-VolumesNegativeTest-1284769613-project-member Apr 18 16:22:47 user devstack@n-api.service[61296]: Apr 18 16:22:47 user devstack@n-api.service[61296]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1649199802", "metadata": {"Type": "work"}}} Apr 18 16:22:47 user devstack@n-api.service[61296]: method: Apr 18 16:22:47 user devstack@n-api.service[61296]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 16:22:47 user devstack@n-api.service[61296]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1649199802', 'metadata': {'Type': 'work'}}}} Apr 18 16:22:47 user devstack@n-api.service[61296]: {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise error Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi '0' Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 16:22:47 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-917b27f3-9b72-4a00-a040-39f57e02bf7f tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:47 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-917b27f3-9b72-4a00-a040-39f57e02bf7f tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015130 Apr 18 16:22:47 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 121/369] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 16:22:47 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 16:22:47 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-a6ba26cb-0b65-4d47-b764-b26d2665abd1 tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Action: 'create', calling method: .version_select at 0x7fd6c94e1f30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-31960529", "metadata": {"Type": "work"}}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:22:47 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-a6ba26cb-0b65-4d47-b764-b26d2665abd1 tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Request method failure captured: Apr 18 16:22:47 user devstack@n-api.service[61294]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 16:22:47 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:22:47 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:22:47 user devstack@n-api.service[61294]: Connection: close Apr 18 16:22:47 user devstack@n-api.service[61294]: Content-Length: 117 Apr 18 16:22:47 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:22:47 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:22:47 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:22:47 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:47 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsPXOb7JB7YyUXghWPCDyWmCG4_dbIgvCiCPUb_InM9Dm8e6-sCLuMaGKGMKTEqaJkjbmcQ7KtZr01FIFfHHFw4zvExEHudiXvQeo-oR4aJPJxLjrtIBz2FZvy4Bwunjj-Pmz3srS4SMA9J5ohZmw6-n-lPj5ob5KvjZF76CmPGNJR0 Apr 18 16:22:47 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:22:47 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:22:47 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:22:47 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:22:47 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:22:47 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:22:47 user devstack@n-api.service[61294]: X-Project-Id: 65096a70d3784ab7aeb6c5caace078e3 Apr 18 16:22:47 user devstack@n-api.service[61294]: X-Project-Name: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:47 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:22:47 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:22:47 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:47 user devstack@n-api.service[61294]: X-Tenant: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:47 user devstack@n-api.service[61294]: X-Tenant-Id: 65096a70d3784ab7aeb6c5caace078e3 Apr 18 16:22:47 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:47 user devstack@n-api.service[61294]: X-User: tempest-VolumesNegativeTest-1284769613-project-member Apr 18 16:22:47 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:22:47 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:22:47 user devstack@n-api.service[61294]: X-User-Id: 20a61b556175475c884c6c3109558c4c Apr 18 16:22:47 user devstack@n-api.service[61294]: X-User-Name: tempest-VolumesNegativeTest-1284769613-project-member Apr 18 16:22:47 user devstack@n-api.service[61294]: Apr 18 16:22:47 user devstack@n-api.service[61294]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-31960529", "metadata": {"Type": "work"}}} Apr 18 16:22:47 user devstack@n-api.service[61294]: method: Apr 18 16:22:47 user devstack@n-api.service[61294]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 16:22:47 user devstack@n-api.service[61294]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-31960529', 'metadata': {'Type': 'work'}}}} Apr 18 16:22:47 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise error Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi '' Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 16:22:47 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-a6ba26cb-0b65-4d47-b764-b26d2665abd1 tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:47 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-a6ba26cb-0b65-4d47-b764-b26d2665abd1 tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010566 Apr 18 16:22:47 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 124/370] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 16:22:47 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 18 16:22:47 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-3784b6a7-409b-4d9e-8c0e-2f6d3e44747f tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Calling method '.version_select at 0x7fd6c937f910>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:47 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-3784b6a7-409b-4d9e-8c0e-2f6d3e44747f tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] HTTP exception thrown: Volume tempest-invalid-878968105 could not be found. Apr 18 16:22:47 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-3784b6a7-409b-4d9e-8c0e-2f6d3e44747f tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Request method failure captured: Apr 18 16:22:47 user devstack@n-api.service[61295]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-878968105 HTTP/1.1 Apr 18 16:22:47 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:22:47 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:22:47 user devstack@n-api.service[61295]: Connection: close Apr 18 16:22:47 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:22:47 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:22:47 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:22:47 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:22:47 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsPXOb7JB7YyUXghWPCDyWmCG4_dbIgvCiCPUb_InM9Dm8e6-sCLuMaGKGMKTEqaJkjbmcQ7KtZr01FIFfHHFw4zvExEHudiXvQeo-oR4aJPJxLjrtIBz2FZvy4Bwunjj-Pmz3srS4SMA9J5ohZmw6-n-lPj5ob5KvjZF76CmPGNJR0 Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Project-Id: 65096a70d3784ab7aeb6c5caace078e3 Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Project-Name: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Tenant: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Tenant-Id: 65096a70d3784ab7aeb6c5caace078e3 Apr 18 16:22:47 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:47 user devstack@n-api.service[61295]: X-User: tempest-VolumesNegativeTest-1284769613-project-member Apr 18 16:22:47 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:22:47 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:22:47 user devstack@n-api.service[61295]: X-User-Id: 20a61b556175475c884c6c3109558c4c Apr 18 16:22:47 user devstack@n-api.service[61295]: X-User-Name: tempest-VolumesNegativeTest-1284769613-project-member Apr 18 16:22:47 user devstack@n-api.service[61295]: method: Apr 18 16:22:47 user devstack@n-api.service[61295]: exception: Volume tempest-invalid-878968105 could not be found. Apr 18 16:22:47 user devstack@n-api.service[61295]: action_args: {'id': 'tempest-invalid-878968105'} Apr 18 16:22:47 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-878968105 could not be found. (HTTP 404) (Request-ID: req-e0ce4fd3-7184-4331-8b0c-67050ea4fa04) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-878968105 could not be found. Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-878968105 could not be found. Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-878968105 could not be found. Apr 18 16:22:47 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:47 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-3784b6a7-409b-4d9e-8c0e-2f6d3e44747f tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Returning 404 to user: Volume tempest-invalid-878968105 could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:47 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-3784b6a7-409b-4d9e-8c0e-2f6d3e44747f tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-878968105" status: 404 len: 98 microversion: 2.1 time: 0.037230 Apr 18 16:22:47 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 126/371] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Apr 18 16:22:47 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-878968105 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 18 16:22:47 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-860fcdb8-c17c-4a8e-a1e5-019676d610e1 tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003804 Apr 18 16:22:47 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 122/372] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 18 16:22:47 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 18 16:22:47 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-03925ad4-5fed-47c5-945d-d9095b213dd6 tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003754 Apr 18 16:22:47 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 125/373] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Apr 18 16:22:47 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 18 16:22:47 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-69301a2d-eaa4-4dad-9047-9894f003cec4 tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Calling method '.version_select at 0x7fd6c937ed40>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:48 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-69301a2d-eaa4-4dad-9047-9894f003cec4 tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] HTTP exception thrown: Volume 9bec2cbb-515d-4255-826f-e0cfdfa25e32 could not be found. Apr 18 16:22:48 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-69301a2d-eaa4-4dad-9047-9894f003cec4 tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Request method failure captured: Apr 18 16:22:48 user devstack@n-api.service[61295]: request: DELETE /compute/v2.1/os-volumes/9bec2cbb-515d-4255-826f-e0cfdfa25e32 HTTP/1.1 Apr 18 16:22:48 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:22:48 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:22:48 user devstack@n-api.service[61295]: Connection: close Apr 18 16:22:48 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:22:48 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:22:48 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:22:48 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:22:48 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:48 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsPXOb7JB7YyUXghWPCDyWmCG4_dbIgvCiCPUb_InM9Dm8e6-sCLuMaGKGMKTEqaJkjbmcQ7KtZr01FIFfHHFw4zvExEHudiXvQeo-oR4aJPJxLjrtIBz2FZvy4Bwunjj-Pmz3srS4SMA9J5ohZmw6-n-lPj5ob5KvjZF76CmPGNJR0 Apr 18 16:22:48 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:22:48 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:22:48 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:22:48 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:22:48 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:22:48 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:22:48 user devstack@n-api.service[61295]: X-Project-Id: 65096a70d3784ab7aeb6c5caace078e3 Apr 18 16:22:48 user devstack@n-api.service[61295]: X-Project-Name: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:48 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:22:48 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:22:48 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:48 user devstack@n-api.service[61295]: X-Tenant: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:48 user devstack@n-api.service[61295]: X-Tenant-Id: 65096a70d3784ab7aeb6c5caace078e3 Apr 18 16:22:48 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:48 user devstack@n-api.service[61295]: X-User: tempest-VolumesNegativeTest-1284769613-project-member Apr 18 16:22:48 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:22:48 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:22:48 user devstack@n-api.service[61295]: X-User-Id: 20a61b556175475c884c6c3109558c4c Apr 18 16:22:48 user devstack@n-api.service[61295]: X-User-Name: tempest-VolumesNegativeTest-1284769613-project-member Apr 18 16:22:48 user devstack@n-api.service[61295]: method: Apr 18 16:22:48 user devstack@n-api.service[61295]: exception: Volume 9bec2cbb-515d-4255-826f-e0cfdfa25e32 could not be found. Apr 18 16:22:48 user devstack@n-api.service[61295]: action_args: {'id': '9bec2cbb-515d-4255-826f-e0cfdfa25e32'} Apr 18 16:22:48 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9bec2cbb-515d-4255-826f-e0cfdfa25e32 could not be found. (HTTP 404) (Request-ID: req-228d5863-310f-42ad-ace8-e115432325b5) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9bec2cbb-515d-4255-826f-e0cfdfa25e32 could not be found. Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9bec2cbb-515d-4255-826f-e0cfdfa25e32 could not be found. Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9bec2cbb-515d-4255-826f-e0cfdfa25e32 could not be found. Apr 18 16:22:48 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:48 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-69301a2d-eaa4-4dad-9047-9894f003cec4 tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Returning 404 to user: Volume 9bec2cbb-515d-4255-826f-e0cfdfa25e32 could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:48 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-69301a2d-eaa4-4dad-9047-9894f003cec4 tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/9bec2cbb-515d-4255-826f-e0cfdfa25e32" status: 404 len: 109 microversion: 2.1 time: 0.040575 Apr 18 16:22:48 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 127/374] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 16:22:47 2023] DELETE /compute/v2.1/os-volumes/9bec2cbb-515d-4255-826f-e0cfdfa25e32 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:22:48 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-6ee0d199-5b91-4828-be20-c26d377c6c4b tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Calling method '.version_select at 0x7fd6c92dcd30>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:48 user devstack@n-api.service[61296]: INFO nova.api.openstack.wsgi [None req-6ee0d199-5b91-4828-be20-c26d377c6c4b tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] HTTP exception thrown: Volume 58b1fb34-81cb-4fff-abbe-194caf956696 could not be found. Apr 18 16:22:48 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-6ee0d199-5b91-4828-be20-c26d377c6c4b tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Request method failure captured: Apr 18 16:22:48 user devstack@n-api.service[61296]: request: GET /compute/v2.1/os-volumes/58b1fb34-81cb-4fff-abbe-194caf956696 HTTP/1.1 Apr 18 16:22:48 user devstack@n-api.service[61296]: Accept: application/json Apr 18 16:22:48 user devstack@n-api.service[61296]: Accept-Encoding: identity Apr 18 16:22:48 user devstack@n-api.service[61296]: Connection: close Apr 18 16:22:48 user devstack@n-api.service[61296]: Content-Length: 0 Apr 18 16:22:48 user devstack@n-api.service[61296]: Content-Type: application/json Apr 18 16:22:48 user devstack@n-api.service[61296]: Host: 10.0.0.210 Apr 18 16:22:48 user devstack@n-api.service[61296]: Openstack-System-Scope: None Apr 18 16:22:48 user devstack@n-api.service[61296]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:48 user devstack@n-api.service[61296]: X-Auth-Token: gAAAAABkPsPXOb7JB7YyUXghWPCDyWmCG4_dbIgvCiCPUb_InM9Dm8e6-sCLuMaGKGMKTEqaJkjbmcQ7KtZr01FIFfHHFw4zvExEHudiXvQeo-oR4aJPJxLjrtIBz2FZvy4Bwunjj-Pmz3srS4SMA9J5ohZmw6-n-lPj5ob5KvjZF76CmPGNJR0 Apr 18 16:22:48 user devstack@n-api.service[61296]: X-Domain-Id: None Apr 18 16:22:48 user devstack@n-api.service[61296]: X-Domain-Name: None Apr 18 16:22:48 user devstack@n-api.service[61296]: X-Identity-Status: Confirmed Apr 18 16:22:48 user devstack@n-api.service[61296]: X-Is-Admin-Project: True Apr 18 16:22:48 user devstack@n-api.service[61296]: X-Project-Domain-Id: default Apr 18 16:22:48 user devstack@n-api.service[61296]: X-Project-Domain-Name: Default Apr 18 16:22:48 user devstack@n-api.service[61296]: X-Project-Id: 65096a70d3784ab7aeb6c5caace078e3 Apr 18 16:22:48 user devstack@n-api.service[61296]: X-Project-Name: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:48 user devstack@n-api.service[61296]: X-Role: reader,member Apr 18 16:22:48 user devstack@n-api.service[61296]: X-Roles: reader,member Apr 18 16:22:48 user devstack@n-api.service[61296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/65096a70d3784ab7aeb6c5caace078e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:48 user devstack@n-api.service[61296]: X-Tenant: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:48 user devstack@n-api.service[61296]: X-Tenant-Id: 65096a70d3784ab7aeb6c5caace078e3 Apr 18 16:22:48 user devstack@n-api.service[61296]: X-Tenant-Name: tempest-VolumesNegativeTest-1284769613 Apr 18 16:22:48 user devstack@n-api.service[61296]: X-User: tempest-VolumesNegativeTest-1284769613-project-member Apr 18 16:22:48 user devstack@n-api.service[61296]: X-User-Domain-Id: default Apr 18 16:22:48 user devstack@n-api.service[61296]: X-User-Domain-Name: Default Apr 18 16:22:48 user devstack@n-api.service[61296]: X-User-Id: 20a61b556175475c884c6c3109558c4c Apr 18 16:22:48 user devstack@n-api.service[61296]: X-User-Name: tempest-VolumesNegativeTest-1284769613-project-member Apr 18 16:22:48 user devstack@n-api.service[61296]: method: Apr 18 16:22:48 user devstack@n-api.service[61296]: exception: Volume 58b1fb34-81cb-4fff-abbe-194caf956696 could not be found. Apr 18 16:22:48 user devstack@n-api.service[61296]: action_args: {'id': '58b1fb34-81cb-4fff-abbe-194caf956696'} Apr 18 16:22:48 user devstack@n-api.service[61296]: {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 58b1fb34-81cb-4fff-abbe-194caf956696 could not be found. (HTTP 404) (Request-ID: req-53a65b3d-2a8e-4b23-9253-dcc4b08a4368) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 58b1fb34-81cb-4fff-abbe-194caf956696 could not be found. Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 58b1fb34-81cb-4fff-abbe-194caf956696 could not be found. Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 58b1fb34-81cb-4fff-abbe-194caf956696 could not be found. Apr 18 16:22:48 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:22:48 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-6ee0d199-5b91-4828-be20-c26d377c6c4b tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] Returning 404 to user: Volume 58b1fb34-81cb-4fff-abbe-194caf956696 could not be found. {{(pid=61296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:48 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-6ee0d199-5b91-4828-be20-c26d377c6c4b tempest-VolumesNegativeTest-1284769613 tempest-VolumesNegativeTest-1284769613-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/58b1fb34-81cb-4fff-abbe-194caf956696" status: 404 len: 109 microversion: 2.1 time: 0.040996 Apr 18 16:22:48 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 123/375] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 16:22:48 2023] GET /compute/v2.1/os-volumes/58b1fb34-81cb-4fff-abbe-194caf956696 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:22:48 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-7fece3fe-2f52-43e7-8db1-83567a61bb08 req-5d24f548-1851-4024-9634-0a4b4d3168e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4febff2-74e8-47ef-820d-f407a4d22d9d", "name": "network-vif-plugged", "status": "completed", "tag": "5e7e767e-18ff-4103-8ea8-ce2a0375d42e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:22:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-7fece3fe-2f52-43e7-8db1-83567a61bb08 req-5d24f548-1851-4024-9634-0a4b4d3168e0 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-7fece3fe-2f52-43e7-8db1-83567a61bb08 req-5d24f548-1851-4024-9634-0a4b4d3168e0 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-7fece3fe-2f52-43e7-8db1-83567a61bb08 req-5d24f548-1851-4024-9634-0a4b4d3168e0 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:48 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-7fece3fe-2f52-43e7-8db1-83567a61bb08 req-5d24f548-1851-4024-9634-0a4b4d3168e0 service nova] Creating event network-vif-plugged:5e7e767e-18ff-4103-8ea8-ce2a0375d42e for instance a4febff2-74e8-47ef-820d-f407a4d22d9d on user Apr 18 16:22:48 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-7fece3fe-2f52-43e7-8db1-83567a61bb08 req-5d24f548-1851-4024-9634-0a4b4d3168e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031911 Apr 18 16:22:48 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 126/376] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:22:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:22:49 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-0a0902e1-ba34-4c81-bc73-1f06f8cdd62c tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:49 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-0a0902e1-ba34-4c81-bc73-1f06f8cdd62c tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] [instance: 5f4e6f9b-5413-4399-83ca-9bc78911db38] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0a0902e1-ba34-4c81-bc73-1f06f8cdd62c tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0a0902e1-ba34-4c81-bc73-1f06f8cdd62c tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0a0902e1-ba34-4c81-bc73-1f06f8cdd62c tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0a0902e1-ba34-4c81-bc73-1f06f8cdd62c tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0a0902e1-ba34-4c81-bc73-1f06f8cdd62c tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0a0902e1-ba34-4c81-bc73-1f06f8cdd62c tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:49 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-0a0902e1-ba34-4c81-bc73-1f06f8cdd62c tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] HTTP exception thrown: Instance 5f4e6f9b-5413-4399-83ca-9bc78911db38 could not be found. Apr 18 16:22:49 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-0a0902e1-ba34-4c81-bc73-1f06f8cdd62c tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Request method failure captured: Apr 18 16:22:49 user devstack@n-api.service[61295]: request: GET /compute/v2.1/servers/5f4e6f9b-5413-4399-83ca-9bc78911db38 HTTP/1.1 Apr 18 16:22:49 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:22:49 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:22:49 user devstack@n-api.service[61295]: Connection: close Apr 18 16:22:49 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:22:49 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:22:49 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:22:49 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:22:49 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:22:49 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsMregX-7PapYV6Fm8OWE0q9r6H2nzMRP2G7bUxQbotpJ8tSSEEB8txlmRGLs8eIRIkNde8GELJnYJzLdp3bLlwqZcRMZjsosaSGDz8EcufBPKB_fY895PiT976CczEuTBTWwgv15gdl3AqTxPd2GwfsjfY9u6hhV4KUnPkeB9-Ad8I Apr 18 16:22:49 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:22:49 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:22:49 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:22:49 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:22:49 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:22:49 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:22:49 user devstack@n-api.service[61295]: X-Project-Id: 000fb9c948224fe3b595882d36cfb859 Apr 18 16:22:49 user devstack@n-api.service[61295]: X-Project-Name: tempest-SnapshotDataIntegrityTests-155672580 Apr 18 16:22:49 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:22:49 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:22:49 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/000fb9c948224fe3b595882d36cfb859"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/000fb9c948224fe3b595882d36cfb859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/000fb9c948224fe3b595882d36cfb859"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:22:49 user devstack@n-api.service[61295]: X-Tenant: tempest-SnapshotDataIntegrityTests-155672580 Apr 18 16:22:49 user devstack@n-api.service[61295]: X-Tenant-Id: 000fb9c948224fe3b595882d36cfb859 Apr 18 16:22:49 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-155672580 Apr 18 16:22:49 user devstack@n-api.service[61295]: X-User: tempest-SnapshotDataIntegrityTests-155672580-project-member Apr 18 16:22:49 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:22:49 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:22:49 user devstack@n-api.service[61295]: X-User-Id: b01da22d0c8c4ee580567646e279d7b9 Apr 18 16:22:49 user devstack@n-api.service[61295]: X-User-Name: tempest-SnapshotDataIntegrityTests-155672580-project-member Apr 18 16:22:49 user devstack@n-api.service[61295]: method: > Apr 18 16:22:49 user devstack@n-api.service[61295]: exception: Instance 5f4e6f9b-5413-4399-83ca-9bc78911db38 could not be found. Apr 18 16:22:49 user devstack@n-api.service[61295]: action_args: {'id': '5f4e6f9b-5413-4399-83ca-9bc78911db38'} Apr 18 16:22:49 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f4e6f9b-5413-4399-83ca-9bc78911db38 could not be found. Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f4e6f9b-5413-4399-83ca-9bc78911db38 could not be found. Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f4e6f9b-5413-4399-83ca-9bc78911db38 could not be found. Apr 18 16:22:49 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:22:49 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-0a0902e1-ba34-4c81-bc73-1f06f8cdd62c tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Returning 404 to user: Instance 5f4e6f9b-5413-4399-83ca-9bc78911db38 could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:22:49 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-0a0902e1-ba34-4c81-bc73-1f06f8cdd62c tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f4e6f9b-5413-4399-83ca-9bc78911db38" status: 404 len: 111 microversion: 2.1 time: 0.031609 Apr 18 16:22:49 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 128/377] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:22:49 2023] GET /compute/v2.1/servers/5f4e6f9b-5413-4399-83ca-9bc78911db38 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:22:49 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-e0041ef1-bef6-407f-9f18-34bba1712c29 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] Calling method '.version_select at 0x7fd6c9243250>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:49 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-e0041ef1-bef6-407f-9f18-34bba1712c29 tempest-SnapshotDataIntegrityTests-155672580 tempest-SnapshotDataIntegrityTests-155672580-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-898730089" status: 202 len: 0 microversion: 2.1 time: 0.024107 Apr 18 16:22:49 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 124/378] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 16:22:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-898730089 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:22:50 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-eaee9eb1-2933-4866-9755-40c0dd322de2 req-ff55e858-6ab0-4671-9c8b-cef276481cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4febff2-74e8-47ef-820d-f407a4d22d9d", "name": "network-vif-plugged", "status": "completed", "tag": "5e7e767e-18ff-4103-8ea8-ce2a0375d42e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:22:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-eaee9eb1-2933-4866-9755-40c0dd322de2 req-ff55e858-6ab0-4671-9c8b-cef276481cab service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-eaee9eb1-2933-4866-9755-40c0dd322de2 req-ff55e858-6ab0-4671-9c8b-cef276481cab service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-eaee9eb1-2933-4866-9755-40c0dd322de2 req-ff55e858-6ab0-4671-9c8b-cef276481cab service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:50 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-eaee9eb1-2933-4866-9755-40c0dd322de2 req-ff55e858-6ab0-4671-9c8b-cef276481cab service nova] Creating event network-vif-plugged:5e7e767e-18ff-4103-8ea8-ce2a0375d42e for instance a4febff2-74e8-47ef-820d-f407a4d22d9d on user Apr 18 16:22:50 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-eaee9eb1-2933-4866-9755-40c0dd322de2 req-ff55e858-6ab0-4671-9c8b-cef276481cab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040373 Apr 18 16:22:50 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 127/379] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:22:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:22:58 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-6c11fec6-beb0-4171-a168-e3af82f534b2 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:58 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-6c11fec6-beb0-4171-a168-e3af82f534b2 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:58 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:58 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6c11fec6-beb0-4171-a168-e3af82f534b2 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6c11fec6-beb0-4171-a168-e3af82f534b2 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6c11fec6-beb0-4171-a168-e3af82f534b2 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6c11fec6-beb0-4171-a168-e3af82f534b2 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6c11fec6-beb0-4171-a168-e3af82f534b2 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:58 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-6c11fec6-beb0-4171-a168-e3af82f534b2 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:58 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=19 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:58 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-6c11fec6-beb0-4171-a168-e3af82f534b2 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Going to try to terminate instance {{(pid=61295) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:22:58 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-6c11fec6-beb0-4171-a168-e3af82f534b2 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 204 len: 0 microversion: 2.1 time: 0.125130 Apr 18 16:22:58 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 129/380] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:22:58 2023] DELETE /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:22:58 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:58 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=6 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:58 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:58 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-c12b6d12-88e5-40d3-871c-d3f5bf1b1712 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:22:58 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-c12b6d12-88e5-40d3-871c-d3f5bf1b1712 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:22:58 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:58 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c12b6d12-88e5-40d3-871c-d3f5bf1b1712 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:58 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c12b6d12-88e5-40d3-871c-d3f5bf1b1712 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:58 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c12b6d12-88e5-40d3-871c-d3f5bf1b1712 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:58 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c12b6d12-88e5-40d3-871c-d3f5bf1b1712 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:58 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c12b6d12-88e5-40d3-871c-d3f5bf1b1712 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:58 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-c12b6d12-88e5-40d3-871c-d3f5bf1b1712 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:59 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-c9d1a52e-8efd-47ee-86eb-3526a3c4cd0b req-cf5c5ebf-1f86-403a-bd06-4bf8d404e434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b530349-680e-4def-86ef-29c340efa175", "name": "network-vif-unplugged", "status": "completed", "tag": "64d26c20-add4-4a63-bace-6a3678032692"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:22:59 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:59 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-c9d1a52e-8efd-47ee-86eb-3526a3c4cd0b req-cf5c5ebf-1f86-403a-bd06-4bf8d404e434 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:22:59 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-c9d1a52e-8efd-47ee-86eb-3526a3c4cd0b req-cf5c5ebf-1f86-403a-bd06-4bf8d404e434 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:22:59 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-c9d1a52e-8efd-47ee-86eb-3526a3c4cd0b req-cf5c5ebf-1f86-403a-bd06-4bf8d404e434 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:22:59 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=23 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:22:59 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-c9d1a52e-8efd-47ee-86eb-3526a3c4cd0b req-cf5c5ebf-1f86-403a-bd06-4bf8d404e434 service nova] Creating event network-vif-unplugged:64d26c20-add4-4a63-bace-6a3678032692 for instance 1b530349-680e-4def-86ef-29c340efa175 on user Apr 18 16:22:59 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-c9d1a52e-8efd-47ee-86eb-3526a3c4cd0b req-cf5c5ebf-1f86-403a-bd06-4bf8d404e434 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036209 Apr 18 16:22:59 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 128/381] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:22:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:22:59 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-c12b6d12-88e5-40d3-871c-d3f5bf1b1712 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b7b9d8fdcf42f29e83e755f4f27380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caa61b19cc4e4cd4bb7d41291c40ef1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:22:59 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-c12b6d12-88e5-40d3-871c-d3f5bf1b1712 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 200 len: 1664 microversion: 2.1 time: 0.372519 Apr 18 16:22:59 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 125/382] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:22:58 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 1664 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 16:23:00 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-e38f87cb-1ece-4555-a3bb-55cec492a488 req-bd40273d-3b15-4d1b-8a10-97b33d6fdaf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b530349-680e-4def-86ef-29c340efa175", "name": "network-vif-deleted", "tag": "64d26c20-add4-4a63-bace-6a3678032692"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:23:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-e38f87cb-1ece-4555-a3bb-55cec492a488 req-bd40273d-3b15-4d1b-8a10-97b33d6fdaf1 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:23:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-e38f87cb-1ece-4555-a3bb-55cec492a488 req-bd40273d-3b15-4d1b-8a10-97b33d6fdaf1 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:23:00 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-e38f87cb-1ece-4555-a3bb-55cec492a488 req-bd40273d-3b15-4d1b-8a10-97b33d6fdaf1 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:23:00 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-e38f87cb-1ece-4555-a3bb-55cec492a488 req-bd40273d-3b15-4d1b-8a10-97b33d6fdaf1 service nova] Creating event network-vif-deleted:64d26c20-add4-4a63-bace-6a3678032692 for instance 1b530349-680e-4def-86ef-29c340efa175 on user Apr 18 16:23:00 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-e38f87cb-1ece-4555-a3bb-55cec492a488 req-bd40273d-3b15-4d1b-8a10-97b33d6fdaf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043081 Apr 18 16:23:00 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 130/383] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:23:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:23:01 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-603e1586-d378-415d-b4cc-a39160b6ad4e req-5932fdb6-ac7d-46f1-af22-b9732ae9df9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b530349-680e-4def-86ef-29c340efa175", "name": "network-vif-plugged", "status": "completed", "tag": "64d26c20-add4-4a63-bace-6a3678032692"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:23:01 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-603e1586-d378-415d-b4cc-a39160b6ad4e req-5932fdb6-ac7d-46f1-af22-b9732ae9df9e service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:23:01 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-603e1586-d378-415d-b4cc-a39160b6ad4e req-5932fdb6-ac7d-46f1-af22-b9732ae9df9e service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:23:01 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-603e1586-d378-415d-b4cc-a39160b6ad4e req-5932fdb6-ac7d-46f1-af22-b9732ae9df9e service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:23:01 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-603e1586-d378-415d-b4cc-a39160b6ad4e req-5932fdb6-ac7d-46f1-af22-b9732ae9df9e service nova] Creating event network-vif-plugged:64d26c20-add4-4a63-bace-6a3678032692 for instance 1b530349-680e-4def-86ef-29c340efa175 on user Apr 18 16:23:01 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-603e1586-d378-415d-b4cc-a39160b6ad4e req-5932fdb6-ac7d-46f1-af22-b9732ae9df9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033152 Apr 18 16:23:01 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 129/384] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:23:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:23:05 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-bacccd18-a1a7-4c9c-87f8-23510759a3c9 tempest-TestStampPattern-562675354 tempest-TestStampPattern-562675354-project-member] Action: 'create', calling method: .version_select at 0x7fd6c9243910>, body: {"keypair": {"name": "tempest-TestStampPattern-1335309435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHJUZDeUZ3LJY9p1/mhwN08Zt4v/90eV5ybtfHh0bdc83467n2NntAEqoukO9MwVlBtKiMCCQOvklZJ9HQS0jm5ZroewQmR/AzRF5hw4RelLxzU/+VjLlL60IjxLQgW7w=="}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:23:05 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-bacccd18-a1a7-4c9c-87f8-23510759a3c9 tempest-TestStampPattern-562675354 tempest-TestStampPattern-562675354-project-member] Getting quotas for project 0db884c5acda46f2867de08431a2887c. Resources: {'key_pairs'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:23:05 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-bacccd18-a1a7-4c9c-87f8-23510759a3c9 tempest-TestStampPattern-562675354 tempest-TestStampPattern-562675354-project-member] Getting quotas for user 5d7dee01f25e4778bdfd10017e8353cd and project 0db884c5acda46f2867de08431a2887c. Resources: {'key_pairs'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:23:05 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-bacccd18-a1a7-4c9c-87f8-23510759a3c9 tempest-TestStampPattern-562675354 tempest-TestStampPattern-562675354-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.286648 Apr 18 16:23:05 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 126/385] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 16:23:05 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:23:08 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-041f6c50-e952-437d-8391-ece4f71d99cd tempest-TestStampPattern-562675354 tempest-TestStampPattern-562675354-project-member] Calling method '.version_select at 0x7fd6c937ff40>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:23:08 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-041f6c50-e952-437d-8391-ece4f71d99cd tempest-TestStampPattern-562675354 tempest-TestStampPattern-562675354-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1335309435" status: 202 len: 0 microversion: 2.1 time: 0.022832 Apr 18 16:23:08 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 131/386] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 16:23:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1335309435 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:23:24 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=3 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:23:24 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=3 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:23:24 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-798254a3-5fd2-48d5-9641-3218d0fd275a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:23:24 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-798254a3-5fd2-48d5-9641-3218d0fd275a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] [instance: c16a352d-3f0c-4688-a890-81be1fee9f35] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:23:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-798254a3-5fd2-48d5-9641-3218d0fd275a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:23:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-798254a3-5fd2-48d5-9641-3218d0fd275a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:23:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-798254a3-5fd2-48d5-9641-3218d0fd275a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:23:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-798254a3-5fd2-48d5-9641-3218d0fd275a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:23:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-798254a3-5fd2-48d5-9641-3218d0fd275a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:23:24 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-798254a3-5fd2-48d5-9641-3218d0fd275a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:23:24 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-798254a3-5fd2-48d5-9641-3218d0fd275a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] HTTP exception thrown: Instance c16a352d-3f0c-4688-a890-81be1fee9f35 could not be found. Apr 18 16:23:24 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-798254a3-5fd2-48d5-9641-3218d0fd275a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Request method failure captured: Apr 18 16:23:24 user devstack@n-api.service[61294]: request: GET /compute/v2.1/servers/c16a352d-3f0c-4688-a890-81be1fee9f35 HTTP/1.1 Apr 18 16:23:24 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:23:24 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:23:24 user devstack@n-api.service[61294]: Connection: close Apr 18 16:23:24 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:23:24 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:23:24 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:23:24 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:23:24 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:23:24 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsNWfG0Q5uQ3KtB3GgScRp5j7lKMWzgEnrLDxrelldGROeqhS-4LrXkmNVwtpqxd3NZkdwXkrJXLYe1oDqdLAvXHGzECQdxmVNHpvVT15ARfMgCzxsxcYVNl90X9ejrQyCaQSoeGyEJtJW1P_cbcPc0ZQ7-oKJVzu4b7dpikuaIqRdU Apr 18 16:23:24 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:23:24 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:23:24 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:23:24 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:23:24 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:23:24 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:23:24 user devstack@n-api.service[61294]: X-Project-Id: fb49d5ddf6db4b1d807ba42fd37a919d Apr 18 16:23:24 user devstack@n-api.service[61294]: X-Project-Name: tempest-VolumesActionsTest-1956026439 Apr 18 16:23:24 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:23:24 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:23:24 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fb49d5ddf6db4b1d807ba42fd37a919d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fb49d5ddf6db4b1d807ba42fd37a919d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fb49d5ddf6db4b1d807ba42fd37a919d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:23:24 user devstack@n-api.service[61294]: X-Tenant: tempest-VolumesActionsTest-1956026439 Apr 18 16:23:24 user devstack@n-api.service[61294]: X-Tenant-Id: fb49d5ddf6db4b1d807ba42fd37a919d Apr 18 16:23:24 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-VolumesActionsTest-1956026439 Apr 18 16:23:24 user devstack@n-api.service[61294]: X-User: tempest-VolumesActionsTest-1956026439-project-member Apr 18 16:23:24 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:23:24 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:23:24 user devstack@n-api.service[61294]: X-User-Id: 3e222f73f9194870b4fac305cdd60f3a Apr 18 16:23:24 user devstack@n-api.service[61294]: X-User-Name: tempest-VolumesActionsTest-1956026439-project-member Apr 18 16:23:24 user devstack@n-api.service[61294]: method: > Apr 18 16:23:24 user devstack@n-api.service[61294]: exception: Instance c16a352d-3f0c-4688-a890-81be1fee9f35 could not be found. Apr 18 16:23:24 user devstack@n-api.service[61294]: action_args: {'id': 'c16a352d-3f0c-4688-a890-81be1fee9f35'} Apr 18 16:23:24 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c16a352d-3f0c-4688-a890-81be1fee9f35 could not be found. Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c16a352d-3f0c-4688-a890-81be1fee9f35 could not be found. Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c16a352d-3f0c-4688-a890-81be1fee9f35 could not be found. Apr 18 16:23:24 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:23:24 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-798254a3-5fd2-48d5-9641-3218d0fd275a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] Returning 404 to user: Instance c16a352d-3f0c-4688-a890-81be1fee9f35 could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:23:24 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-798254a3-5fd2-48d5-9641-3218d0fd275a tempest-VolumesActionsTest-1956026439 tempest-VolumesActionsTest-1956026439-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c16a352d-3f0c-4688-a890-81be1fee9f35" status: 404 len: 111 microversion: 2.1 time: 0.033309 Apr 18 16:23:24 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 130/387] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:23:24 2023] GET /compute/v2.1/servers/c16a352d-3f0c-4688-a890-81be1fee9f35 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:23:32 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=6 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:23:32 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=4 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:23:32 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:23:32 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-73c7bb86-efac-4701-9e05-bf9d91e40c89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:23:32 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-73c7bb86-efac-4701-9e05-bf9d91e40c89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: a4febff2-74e8-47ef-820d-f407a4d22d9d] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:23:32 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-73c7bb86-efac-4701-9e05-bf9d91e40c89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:23:32 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-73c7bb86-efac-4701-9e05-bf9d91e40c89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:23:32 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-73c7bb86-efac-4701-9e05-bf9d91e40c89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:23:32 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-73c7bb86-efac-4701-9e05-bf9d91e40c89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:23:32 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-73c7bb86-efac-4701-9e05-bf9d91e40c89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:23:32 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-73c7bb86-efac-4701-9e05-bf9d91e40c89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:23:33 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-73c7bb86-efac-4701-9e05-bf9d91e40c89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2963911de4f34d79816a9a1f9ad24a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5695adbb14ea4162bc40547b1509a1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:23:33 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-73c7bb86-efac-4701-9e05-bf9d91e40c89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d" status: 200 len: 1494 microversion: 2.1 time: 0.234729 Apr 18 16:23:33 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 127/388] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:23:32 2023] GET /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d => generated 1494 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:23:40 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:23:40 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:23:41 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-4a4db533-5453-40dd-8695-8875503b31a2 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1649651602"}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:23:41 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-4a4db533-5453-40dd-8695-8875503b31a2 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:23:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4a4db533-5453-40dd-8695-8875503b31a2 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:23:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4a4db533-5453-40dd-8695-8875503b31a2 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:23:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4a4db533-5453-40dd-8695-8875503b31a2 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:23:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4a4db533-5453-40dd-8695-8875503b31a2 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:23:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4a4db533-5453-40dd-8695-8875503b31a2 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:23:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4a4db533-5453-40dd-8695-8875503b31a2 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:23:41 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-4a4db533-5453-40dd-8695-8875503b31a2 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6aece7dd-d545-4e26-9cb7-30ee0b01ebb2/action" status: 202 len: 52 microversion: 2.87 time: 0.926413 Apr 18 16:23:41 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 132/389] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 18 16:23:40 2023] POST /compute/v2.1/servers/6aece7dd-d545-4e26-9cb7-30ee0b01ebb2/action => generated 52 bytes in 928 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 18 16:23:47 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-014802ae-1f37-4352-ac0c-e74a911a7533 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:23:47 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-014802ae-1f37-4352-ac0c-e74a911a7533 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:23:47 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:23:47 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:23:47 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-014802ae-1f37-4352-ac0c-e74a911a7533 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:23:47 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-014802ae-1f37-4352-ac0c-e74a911a7533 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:23:47 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-014802ae-1f37-4352-ac0c-e74a911a7533 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:23:47 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-014802ae-1f37-4352-ac0c-e74a911a7533 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:23:47 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-014802ae-1f37-4352-ac0c-e74a911a7533 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:23:47 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-014802ae-1f37-4352-ac0c-e74a911a7533 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:23:47 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-014802ae-1f37-4352-ac0c-e74a911a7533 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:23:47 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-014802ae-1f37-4352-ac0c-e74a911a7533 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:23:47 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-014802ae-1f37-4352-ac0c-e74a911a7533 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:23:47 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-014802ae-1f37-4352-ac0c-e74a911a7533 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6aece7dd-d545-4e26-9cb7-30ee0b01ebb2" status: 200 len: 1691 microversion: 2.87 time: 0.429040 Apr 18 16:23:47 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 131/390] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:23:47 2023] GET /compute/v2.1/servers/6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 => generated 1691 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:23:49 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-3e053bc3-493c-4c30-8918-c62f6f076f23 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:23:49 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-3e053bc3-493c-4c30-8918-c62f6f076f23 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] [instance: 1b530349-680e-4def-86ef-29c340efa175] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:23:49 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:23:49 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=6 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:23:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3e053bc3-493c-4c30-8918-c62f6f076f23 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:23:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3e053bc3-493c-4c30-8918-c62f6f076f23 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:23:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3e053bc3-493c-4c30-8918-c62f6f076f23 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:23:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3e053bc3-493c-4c30-8918-c62f6f076f23 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:23:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3e053bc3-493c-4c30-8918-c62f6f076f23 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:23:49 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3e053bc3-493c-4c30-8918-c62f6f076f23 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:23:49 user devstack@n-api.service[61296]: INFO nova.api.openstack.wsgi [None req-3e053bc3-493c-4c30-8918-c62f6f076f23 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] HTTP exception thrown: Instance 1b530349-680e-4def-86ef-29c340efa175 could not be found. Apr 18 16:23:49 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-3e053bc3-493c-4c30-8918-c62f6f076f23 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Request method failure captured: Apr 18 16:23:49 user devstack@n-api.service[61296]: request: GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 HTTP/1.1 Apr 18 16:23:49 user devstack@n-api.service[61296]: Accept: application/json Apr 18 16:23:49 user devstack@n-api.service[61296]: Accept-Encoding: identity Apr 18 16:23:49 user devstack@n-api.service[61296]: Connection: close Apr 18 16:23:49 user devstack@n-api.service[61296]: Content-Length: 0 Apr 18 16:23:49 user devstack@n-api.service[61296]: Content-Type: application/json Apr 18 16:23:49 user devstack@n-api.service[61296]: Host: 10.0.0.210 Apr 18 16:23:49 user devstack@n-api.service[61296]: Openstack-System-Scope: None Apr 18 16:23:49 user devstack@n-api.service[61296]: User-Agent: python-urllib3/1.26.15 Apr 18 16:23:49 user devstack@n-api.service[61296]: X-Auth-Token: gAAAAABkPsHEqRpL-PouwBiUgQyeGTg05sYflymCmT9aUuDUQGqWRvZalzOYZvX9r1jGAfyyfExi-6N9aMLYWL0nbXCxslB-ku_TFtc23_lVgTYAyMYkBOSaBLuqBmezGRz4FFrfUgsuKGKyWT9VZ9HOcVwxoYNtbJUMvyfPLwB6bwv_J3_OrPk Apr 18 16:23:49 user devstack@n-api.service[61296]: X-Domain-Id: None Apr 18 16:23:49 user devstack@n-api.service[61296]: X-Domain-Name: None Apr 18 16:23:49 user devstack@n-api.service[61296]: X-Identity-Status: Confirmed Apr 18 16:23:49 user devstack@n-api.service[61296]: X-Is-Admin-Project: True Apr 18 16:23:49 user devstack@n-api.service[61296]: X-Project-Domain-Id: default Apr 18 16:23:49 user devstack@n-api.service[61296]: X-Project-Domain-Name: Default Apr 18 16:23:49 user devstack@n-api.service[61296]: X-Project-Id: caa61b19cc4e4cd4bb7d41291c40ef1f Apr 18 16:23:49 user devstack@n-api.service[61296]: X-Project-Name: tempest-ServerActionsTestJSON-1239704997 Apr 18 16:23:49 user devstack@n-api.service[61296]: X-Role: reader,member Apr 18 16:23:49 user devstack@n-api.service[61296]: X-Roles: reader,member Apr 18 16:23:49 user devstack@n-api.service[61296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/caa61b19cc4e4cd4bb7d41291c40ef1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/caa61b19cc4e4cd4bb7d41291c40ef1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/caa61b19cc4e4cd4bb7d41291c40ef1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:23:49 user devstack@n-api.service[61296]: X-Tenant: tempest-ServerActionsTestJSON-1239704997 Apr 18 16:23:49 user devstack@n-api.service[61296]: X-Tenant-Id: caa61b19cc4e4cd4bb7d41291c40ef1f Apr 18 16:23:49 user devstack@n-api.service[61296]: X-Tenant-Name: tempest-ServerActionsTestJSON-1239704997 Apr 18 16:23:49 user devstack@n-api.service[61296]: X-User: tempest-ServerActionsTestJSON-1239704997-project-member Apr 18 16:23:49 user devstack@n-api.service[61296]: X-User-Domain-Id: default Apr 18 16:23:49 user devstack@n-api.service[61296]: X-User-Domain-Name: Default Apr 18 16:23:49 user devstack@n-api.service[61296]: X-User-Id: 07b7b9d8fdcf42f29e83e755f4f27380 Apr 18 16:23:49 user devstack@n-api.service[61296]: X-User-Name: tempest-ServerActionsTestJSON-1239704997-project-member Apr 18 16:23:49 user devstack@n-api.service[61296]: method: > Apr 18 16:23:49 user devstack@n-api.service[61296]: exception: Instance 1b530349-680e-4def-86ef-29c340efa175 could not be found. Apr 18 16:23:49 user devstack@n-api.service[61296]: action_args: {'id': '1b530349-680e-4def-86ef-29c340efa175'} Apr 18 16:23:49 user devstack@n-api.service[61296]: {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b530349-680e-4def-86ef-29c340efa175 could not be found. Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b530349-680e-4def-86ef-29c340efa175 could not be found. Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b530349-680e-4def-86ef-29c340efa175 could not be found. Apr 18 16:23:49 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:23:49 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-3e053bc3-493c-4c30-8918-c62f6f076f23 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Returning 404 to user: Instance 1b530349-680e-4def-86ef-29c340efa175 could not be found. {{(pid=61296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:23:49 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-3e053bc3-493c-4c30-8918-c62f6f076f23 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175" status: 404 len: 111 microversion: 2.1 time: 0.032194 Apr 18 16:23:49 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 128/391] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:23:49 2023] GET /compute/v2.1/servers/1b530349-680e-4def-86ef-29c340efa175 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:23:49 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-06879caf-681a-4a9f-8ca1-03a8e91a8021 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] Calling method '.version_select at 0x7fd6c937e710>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:23:49 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-06879caf-681a-4a9f-8ca1-03a8e91a8021 tempest-ServerActionsTestJSON-1239704997 tempest-ServerActionsTestJSON-1239704997-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-228479226" status: 202 len: 0 microversion: 2.1 time: 0.021090 Apr 18 16:23:49 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 133/392] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 16:23:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-228479226 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:23:56 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-b2e1fd19-fdb9-4720-96f6-8298a624a48e tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Action: 'create', calling method: .version_select at 0x7fd6c94e3a30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1759395561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaEdQSpuucmjUI7CgJV9d16I0XBov7QClewDi9SugBZN+QXiQWDSnpN5XqyApn5LKFQekmnDneoXwFp0uoqimvSuH7yO+qi9pw7ukWtt3Q/33VBcmVZNDF9YXa9rca7pw=="}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:23:56 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-b2e1fd19-fdb9-4720-96f6-8298a624a48e tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Getting quotas for project 00d4b993c13b46ea8f80b0caed60a373. Resources: {'key_pairs'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:23:56 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-b2e1fd19-fdb9-4720-96f6-8298a624a48e tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Getting quotas for user add4c9d906ba49a590f203e0aa98ab64 and project 00d4b993c13b46ea8f80b0caed60a373. Resources: {'key_pairs'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:23:57 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-b2e1fd19-fdb9-4720-96f6-8298a624a48e tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046039 Apr 18 16:23:57 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 132/393] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 16:23:56 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1809716632", "imageRef": "96f134fc-75ab-496a-9864-a702b8f45c60", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1759395561", "networks": [{"uuid": "1cb85bc6-49f1-46be-91c8-d814b48c2a99"}]}} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG nova.network.neutron [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] validate_networks() for [('1cb85bc6-49f1-46be-91c8-d814b48c2a99', None, None, None, None, None)] {{(pid=61296) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Flavor limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Image limits 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Flavor pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Image pref 0:0:0 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG nova.virt.hardware [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Getting quotas for project 00d4b993c13b46ea8f80b0caed60a373. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG nova.quota [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Getting quotas for user add4c9d906ba49a590f203e0aa98ab64 and project 00d4b993c13b46ea8f80b0caed60a373. Resources: {'cores', 'ram', 'instances'} {{(pid=61296) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Going to run 1 instances... {{(pid=61296) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:23:57 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 776d1402-3e8a-407d-a20d-db46c1a21b23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='96f134fc-75ab-496a-9864-a702b8f45c60',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:23:57 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-3ce238d2-be81-4537-99b2-f4d180f423a9 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.808553 Apr 18 16:23:57 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 129/394] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:23:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:23:57 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:23:57 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-2dd64a45-dd96-4db8-adf2-acdf4cf68b6d tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:23:57 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-2dd64a45-dd96-4db8-adf2-acdf4cf68b6d tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 776d1402-3e8a-407d-a20d-db46c1a21b23] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:23:58 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-2dd64a45-dd96-4db8-adf2-acdf4cf68b6d tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add4c9d906ba49a590f203e0aa98ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4b993c13b46ea8f80b0caed60a373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:23:58 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-2dd64a45-dd96-4db8-adf2-acdf4cf68b6d tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "GET /compute/v2.1/servers/776d1402-3e8a-407d-a20d-db46c1a21b23" status: 200 len: 1253 microversion: 2.1 time: 0.230580 Apr 18 16:23:58 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 134/395] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:23:57 2023] GET /compute/v2.1/servers/776d1402-3e8a-407d-a20d-db46c1a21b23 => generated 1253 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:24:00 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=6 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:00 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-277ad55d-0d5f-4a29-93c1-cd218a58ad67 req-d0ea3c0a-9602-4101-a805-24bf7649a6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "776d1402-3e8a-407d-a20d-db46c1a21b23", "tag": "61df4fc4-1d98-4d7b-b74e-280c61eac6ee"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:24:00 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-277ad55d-0d5f-4a29-93c1-cd218a58ad67 req-d0ea3c0a-9602-4101-a805-24bf7649a6e6 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:24:00 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-277ad55d-0d5f-4a29-93c1-cd218a58ad67 req-d0ea3c0a-9602-4101-a805-24bf7649a6e6 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:24:00 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-277ad55d-0d5f-4a29-93c1-cd218a58ad67 req-d0ea3c0a-9602-4101-a805-24bf7649a6e6 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:24:00 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-277ad55d-0d5f-4a29-93c1-cd218a58ad67 req-d0ea3c0a-9602-4101-a805-24bf7649a6e6 service nova] Creating event network-changed:61df4fc4-1d98-4d7b-b74e-280c61eac6ee for instance 776d1402-3e8a-407d-a20d-db46c1a21b23 on user Apr 18 16:24:00 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-277ad55d-0d5f-4a29-93c1-cd218a58ad67 req-d0ea3c0a-9602-4101-a805-24bf7649a6e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030118 Apr 18 16:24:00 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 133/396] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:24:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:24:02 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-50c360fd-f9ca-4ac3-a5bf-95f6526679b5 req-5ef00d67-344f-4a04-a895-35d3453fff86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776d1402-3e8a-407d-a20d-db46c1a21b23", "name": "network-vif-plugged", "status": "completed", "tag": "61df4fc4-1d98-4d7b-b74e-280c61eac6ee"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:24:02 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-50c360fd-f9ca-4ac3-a5bf-95f6526679b5 req-5ef00d67-344f-4a04-a895-35d3453fff86 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:24:02 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-50c360fd-f9ca-4ac3-a5bf-95f6526679b5 req-5ef00d67-344f-4a04-a895-35d3453fff86 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:24:02 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-50c360fd-f9ca-4ac3-a5bf-95f6526679b5 req-5ef00d67-344f-4a04-a895-35d3453fff86 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:24:02 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-50c360fd-f9ca-4ac3-a5bf-95f6526679b5 req-5ef00d67-344f-4a04-a895-35d3453fff86 service nova] Creating event network-vif-plugged:61df4fc4-1d98-4d7b-b74e-280c61eac6ee for instance 776d1402-3e8a-407d-a20d-db46c1a21b23 on user Apr 18 16:24:02 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-50c360fd-f9ca-4ac3-a5bf-95f6526679b5 req-5ef00d67-344f-4a04-a895-35d3453fff86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041860 Apr 18 16:24:02 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 130/397] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:24:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:24:04 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-a190f1f3-6f37-4952-b3a0-4039112952d3 req-246da944-4603-4450-a827-65b0b370d8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776d1402-3e8a-407d-a20d-db46c1a21b23", "name": "network-vif-plugged", "status": "completed", "tag": "61df4fc4-1d98-4d7b-b74e-280c61eac6ee"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:24:04 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-a190f1f3-6f37-4952-b3a0-4039112952d3 req-246da944-4603-4450-a827-65b0b370d8b9 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:24:04 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-a190f1f3-6f37-4952-b3a0-4039112952d3 req-246da944-4603-4450-a827-65b0b370d8b9 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:24:04 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-a190f1f3-6f37-4952-b3a0-4039112952d3 req-246da944-4603-4450-a827-65b0b370d8b9 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:24:04 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-a190f1f3-6f37-4952-b3a0-4039112952d3 req-246da944-4603-4450-a827-65b0b370d8b9 service nova] Creating event network-vif-plugged:61df4fc4-1d98-4d7b-b74e-280c61eac6ee for instance 776d1402-3e8a-407d-a20d-db46c1a21b23 on user Apr 18 16:24:04 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-a190f1f3-6f37-4952-b3a0-4039112952d3 req-246da944-4603-4450-a827-65b0b370d8b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029598 Apr 18 16:24:04 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 135/398] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:24:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:24:26 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=4 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:26 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:26 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:26 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-2082ade6-86f6-47b2-bdcf-4c39031b88ba tempest-TestVolumeBootPattern-212646698 tempest-TestVolumeBootPattern-212646698-project-member] Action: 'create', calling method: .version_select at 0x7fd6c94e1c60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1360127751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4vPLiP4hqZkGsElhODoF0WrYB014JK6ow2kT4ZEJjhNYd9AWXkrY1iWzRX2MUad9Xu4cSu/vTZVhpMBIIhJF+rqu8pxWr9M6cMncCUb0LnsDOb+l/m32rD4VtS3ZcnEw=="}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:24:26 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-2082ade6-86f6-47b2-bdcf-4c39031b88ba tempest-TestVolumeBootPattern-212646698 tempest-TestVolumeBootPattern-212646698-project-member] Getting quotas for project 52f07ca2c95045ce911c9901ff92ba1f. Resources: {'key_pairs'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:24:26 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-2082ade6-86f6-47b2-bdcf-4c39031b88ba tempest-TestVolumeBootPattern-212646698 tempest-TestVolumeBootPattern-212646698-project-member] Getting quotas for user 873f51035f194bedaa07267280bff999 and project 52f07ca2c95045ce911c9901ff92ba1f. Resources: {'key_pairs'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:24:26 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-2082ade6-86f6-47b2-bdcf-4c39031b88ba tempest-TestVolumeBootPattern-212646698 tempest-TestVolumeBootPattern-212646698-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.050809 Apr 18 16:24:26 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 134/399] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 16:24:26 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:24:29 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:29 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=6 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:29 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:29 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=6 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:29 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-da76c1f5-20e5-4700-92cb-4e2cef5b3a9d tempest-TestVolumeBootPattern-212646698 tempest-TestVolumeBootPattern-212646698-project-member] Calling method '.version_select at 0x7fd6c9409fc0>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:24:30 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-da76c1f5-20e5-4700-92cb-4e2cef5b3a9d tempest-TestVolumeBootPattern-212646698 tempest-TestVolumeBootPattern-212646698-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1360127751" status: 202 len: 0 microversion: 2.1 time: 0.031389 Apr 18 16:24:30 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 131/400] 10.0.0.210 () {62 vars in 1340 bytes} [Tue Apr 18 16:24:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1360127751 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:24:33 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:33 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:33 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:33 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-7167605d-f6c0-4a3e-9611-d79ec436cbe2 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:24:33 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-7167605d-f6c0-4a3e-9611-d79ec436cbe2 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: a4febff2-74e8-47ef-820d-f407a4d22d9d] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:24:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-7167605d-f6c0-4a3e-9611-d79ec436cbe2 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:24:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-7167605d-f6c0-4a3e-9611-d79ec436cbe2 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:24:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-7167605d-f6c0-4a3e-9611-d79ec436cbe2 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:24:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-7167605d-f6c0-4a3e-9611-d79ec436cbe2 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:24:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-7167605d-f6c0-4a3e-9611-d79ec436cbe2 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:24:33 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-7167605d-f6c0-4a3e-9611-d79ec436cbe2 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:24:33 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-7167605d-f6c0-4a3e-9611-d79ec436cbe2 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: a4febff2-74e8-47ef-820d-f407a4d22d9d] Going to try to terminate instance {{(pid=61295) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:24:33 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-7167605d-f6c0-4a3e-9611-d79ec436cbe2 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d" status: 204 len: 0 microversion: 2.1 time: 0.125212 Apr 18 16:24:33 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 136/401] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:24:33 2023] DELETE /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:24:33 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-13b778b8-4ff9-4328-9812-1fa5913b2395 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:24:33 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-13b778b8-4ff9-4328-9812-1fa5913b2395 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: a4febff2-74e8-47ef-820d-f407a4d22d9d] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:24:33 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-13b778b8-4ff9-4328-9812-1fa5913b2395 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:24:33 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-13b778b8-4ff9-4328-9812-1fa5913b2395 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:24:33 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-13b778b8-4ff9-4328-9812-1fa5913b2395 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:24:33 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-13b778b8-4ff9-4328-9812-1fa5913b2395 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:24:33 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-13b778b8-4ff9-4328-9812-1fa5913b2395 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:24:33 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-13b778b8-4ff9-4328-9812-1fa5913b2395 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:24:33 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-13b778b8-4ff9-4328-9812-1fa5913b2395 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2963911de4f34d79816a9a1f9ad24a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5695adbb14ea4162bc40547b1509a1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:24:33 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-13b778b8-4ff9-4328-9812-1fa5913b2395 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d" status: 200 len: 1500 microversion: 2.1 time: 0.328417 Apr 18 16:24:33 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 135/402] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:24:33 2023] GET /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d => generated 1500 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:24:33 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-81435a4a-deda-4558-9286-c61db5691100 req-105fac50-9111-4744-8c97-bc301f3c73cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4febff2-74e8-47ef-820d-f407a4d22d9d", "name": "network-vif-unplugged", "status": "completed", "tag": "5e7e767e-18ff-4103-8ea8-ce2a0375d42e"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:24:33 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-81435a4a-deda-4558-9286-c61db5691100 req-105fac50-9111-4744-8c97-bc301f3c73cf service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:24:33 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-81435a4a-deda-4558-9286-c61db5691100 req-105fac50-9111-4744-8c97-bc301f3c73cf service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:24:33 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-81435a4a-deda-4558-9286-c61db5691100 req-105fac50-9111-4744-8c97-bc301f3c73cf service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:24:33 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-81435a4a-deda-4558-9286-c61db5691100 req-105fac50-9111-4744-8c97-bc301f3c73cf service nova] Creating event network-vif-unplugged:5e7e767e-18ff-4103-8ea8-ce2a0375d42e for instance a4febff2-74e8-47ef-820d-f407a4d22d9d on user Apr 18 16:24:33 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-81435a4a-deda-4558-9286-c61db5691100 req-105fac50-9111-4744-8c97-bc301f3c73cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151859 Apr 18 16:24:33 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 132/403] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:24:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:24:35 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-35643683-3233-4e4d-abf9-ed4465b0a7ab req-4995bf58-5fde-4587-917a-6c451d91f271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4febff2-74e8-47ef-820d-f407a4d22d9d", "name": "network-vif-plugged", "status": "completed", "tag": "5e7e767e-18ff-4103-8ea8-ce2a0375d42e"}, {"server_uuid": "a4febff2-74e8-47ef-820d-f407a4d22d9d", "name": "network-vif-deleted", "tag": "5e7e767e-18ff-4103-8ea8-ce2a0375d42e"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:24:35 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-35643683-3233-4e4d-abf9-ed4465b0a7ab req-4995bf58-5fde-4587-917a-6c451d91f271 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:24:35 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-35643683-3233-4e4d-abf9-ed4465b0a7ab req-4995bf58-5fde-4587-917a-6c451d91f271 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:24:35 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-35643683-3233-4e4d-abf9-ed4465b0a7ab req-4995bf58-5fde-4587-917a-6c451d91f271 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:24:35 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-35643683-3233-4e4d-abf9-ed4465b0a7ab req-4995bf58-5fde-4587-917a-6c451d91f271 service nova] Creating event network-vif-plugged:5e7e767e-18ff-4103-8ea8-ce2a0375d42e for instance a4febff2-74e8-47ef-820d-f407a4d22d9d on user Apr 18 16:24:35 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-35643683-3233-4e4d-abf9-ed4465b0a7ab req-4995bf58-5fde-4587-917a-6c451d91f271 service nova] Creating event network-vif-deleted:5e7e767e-18ff-4103-8ea8-ce2a0375d42e for instance a4febff2-74e8-47ef-820d-f407a4d22d9d on user Apr 18 16:24:35 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-35643683-3233-4e4d-abf9-ed4465b0a7ab req-4995bf58-5fde-4587-917a-6c451d91f271 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030771 Apr 18 16:24:35 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 137/404] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:24:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:24:47 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1790437573", "imageRef": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "b11a20de-f82a-4158-b53e-0a0c7a1552cb", "destination_type": "volume"}], "networks": [{"uuid": "923d10dc-c67e-4426-9c6e-856e903e2446"}]}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:24:47 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=4 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:47 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:47 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=6 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:47 user devstack@n-api.service[61294]: DEBUG nova.network.neutron [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] validate_networks() for [('923d10dc-c67e-4426-9c6e-856e903e2446', None, None, None, None, None)] {{(pid=61294) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:24:48 user devstack@n-api.service[61294]: DEBUG nova.virt.hardware [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Flavor limits 0:0:0 {{(pid=61294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:24:48 user devstack@n-api.service[61294]: DEBUG nova.virt.hardware [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Image limits 0:0:0 {{(pid=61294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:24:48 user devstack@n-api.service[61294]: DEBUG nova.virt.hardware [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Flavor pref 0:0:0 {{(pid=61294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:24:48 user devstack@n-api.service[61294]: DEBUG nova.virt.hardware [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Image pref 0:0:0 {{(pid=61294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:24:48 user devstack@n-api.service[61294]: DEBUG nova.virt.hardware [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61294) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:24:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:24:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:24:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:24:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:24:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:24:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:24:48 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Getting quotas for project f516f5ec45ca4508841c77f79e8c038b. Resources: {'cores', 'ram', 'instances'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:24:48 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Getting quotas for user c54c277689214bd0a2cadb1e2ac288a9 and project f516f5ec45ca4508841c77f79e8c038b. Resources: {'cores', 'ram', 'instances'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:24:48 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Going to run 1 instances... {{(pid=61294) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:24:48 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b11a20de-f82a-4158-b53e-0a0c7a1552cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61294) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:24:48 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-ef4d3a05-460e-4caf-b497-003f15e39ce1 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.548950 Apr 18 16:24:48 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 136/405] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 16:24:47 2023] POST /compute/v2.1/servers => generated 378 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 16:24:48 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:48 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:48 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-e5bb2559-ed3b-4754-b824-981301c792ad tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:24:48 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-e5bb2559-ed3b-4754-b824-981301c792ad tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:24:48 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:48 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:24:48 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-c175d37b-8eb0-4c45-abe6-cf4ed7bc9ab4 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:24:48 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-c175d37b-8eb0-4c45-abe6-cf4ed7bc9ab4 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 776d1402-3e8a-407d-a20d-db46c1a21b23] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:24:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-c175d37b-8eb0-4c45-abe6-cf4ed7bc9ab4 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:24:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-c175d37b-8eb0-4c45-abe6-cf4ed7bc9ab4 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:24:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-c175d37b-8eb0-4c45-abe6-cf4ed7bc9ab4 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:24:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-c175d37b-8eb0-4c45-abe6-cf4ed7bc9ab4 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:24:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-c175d37b-8eb0-4c45-abe6-cf4ed7bc9ab4 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:24:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-c175d37b-8eb0-4c45-abe6-cf4ed7bc9ab4 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:24:48 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-e5bb2559-ed3b-4754-b824-981301c792ad tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:24:48 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-e5bb2559-ed3b-4754-b824-981301c792ad tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:24:48 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-e5bb2559-ed3b-4754-b824-981301c792ad tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:24:48 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-e5bb2559-ed3b-4754-b824-981301c792ad tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50137f3d-a6c4-4ac5-8edb-fd5941f4e43b" status: 200 len: 1395 microversion: 2.87 time: 0.101617 Apr 18 16:24:48 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 133/406] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:24:48 2023] GET /compute/v2.1/servers/50137f3d-a6c4-4ac5-8edb-fd5941f4e43b => generated 1395 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:24:48 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-c175d37b-8eb0-4c45-abe6-cf4ed7bc9ab4 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add4c9d906ba49a590f203e0aa98ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4b993c13b46ea8f80b0caed60a373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:24:48 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-c175d37b-8eb0-4c45-abe6-cf4ed7bc9ab4 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "GET /compute/v2.1/servers/776d1402-3e8a-407d-a20d-db46c1a21b23" status: 200 len: 1538 microversion: 2.1 time: 0.249252 Apr 18 16:24:48 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 138/407] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:24:48 2023] GET /compute/v2.1/servers/776d1402-3e8a-407d-a20d-db46c1a21b23 => generated 1538 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:24:50 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-7098cf00-a929-4e51-b3cd-236bf4fe51fc req-1ecbee5d-8ee8-419e-a3f1-9f26efa54e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50137f3d-a6c4-4ac5-8edb-fd5941f4e43b", "tag": "b276194f-7dad-4a54-9b79-874ee97bffc0"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:24:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-7098cf00-a929-4e51-b3cd-236bf4fe51fc req-1ecbee5d-8ee8-419e-a3f1-9f26efa54e09 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:24:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-7098cf00-a929-4e51-b3cd-236bf4fe51fc req-1ecbee5d-8ee8-419e-a3f1-9f26efa54e09 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:24:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-7098cf00-a929-4e51-b3cd-236bf4fe51fc req-1ecbee5d-8ee8-419e-a3f1-9f26efa54e09 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:24:50 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-7098cf00-a929-4e51-b3cd-236bf4fe51fc req-1ecbee5d-8ee8-419e-a3f1-9f26efa54e09 service nova] Creating event network-changed:b276194f-7dad-4a54-9b79-874ee97bffc0 for instance 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b on user Apr 18 16:24:50 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-7098cf00-a929-4e51-b3cd-236bf4fe51fc req-1ecbee5d-8ee8-419e-a3f1-9f26efa54e09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028632 Apr 18 16:24:50 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 137/408] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:24:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:24:55 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-7d65f7d8-8f56-42ce-8464-20b47fc7a04f req-d3a2a960-eb39-4f43-94d0-23ec3e06f875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50137f3d-a6c4-4ac5-8edb-fd5941f4e43b", "name": "network-vif-deleted", "tag": "b276194f-7dad-4a54-9b79-874ee97bffc0"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:24:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-7d65f7d8-8f56-42ce-8464-20b47fc7a04f req-d3a2a960-eb39-4f43-94d0-23ec3e06f875 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:24:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-7d65f7d8-8f56-42ce-8464-20b47fc7a04f req-d3a2a960-eb39-4f43-94d0-23ec3e06f875 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:24:55 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-7d65f7d8-8f56-42ce-8464-20b47fc7a04f req-d3a2a960-eb39-4f43-94d0-23ec3e06f875 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:24:55 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.compute.server_external_events [req-7d65f7d8-8f56-42ce-8464-20b47fc7a04f req-d3a2a960-eb39-4f43-94d0-23ec3e06f875 service nova] Unable to find a host for instance 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b. Dropping event network-vif-deleted {{(pid=61296) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 18 16:24:55 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-7d65f7d8-8f56-42ce-8464-20b47fc7a04f req-d3a2a960-eb39-4f43-94d0-23ec3e06f875 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.026390 Apr 18 16:24:55 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 134/409] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:24:55 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 18 16:25:23 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-9435b9e2-51e3-49f5-a29f-9dd459770a3e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:25:23 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-9435b9e2-51e3-49f5-a29f-9dd459770a3e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: a4febff2-74e8-47ef-820d-f407a4d22d9d] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:25:23 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:25:23 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=6 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:25:23 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-9435b9e2-51e3-49f5-a29f-9dd459770a3e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:23 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-9435b9e2-51e3-49f5-a29f-9dd459770a3e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:23 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-9435b9e2-51e3-49f5-a29f-9dd459770a3e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:23 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-9435b9e2-51e3-49f5-a29f-9dd459770a3e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:23 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-9435b9e2-51e3-49f5-a29f-9dd459770a3e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:23 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-9435b9e2-51e3-49f5-a29f-9dd459770a3e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:23 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-9435b9e2-51e3-49f5-a29f-9dd459770a3e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] HTTP exception thrown: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. Apr 18 16:25:23 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-9435b9e2-51e3-49f5-a29f-9dd459770a3e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Request method failure captured: Apr 18 16:25:23 user devstack@n-api.service[61295]: request: GET /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d HTTP/1.1 Apr 18 16:25:23 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:25:23 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:25:23 user devstack@n-api.service[61295]: Connection: close Apr 18 16:25:23 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:25:23 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:25:23 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:25:23 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:25:23 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:25:23 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsNidtOiGLu9U3NCLnT1tVML4gMuuQHVkB4nmR2sX9o1kAxzT-cfYGjSwNLbZzkESy4kLqtoL1_yM09EZ-hGt6lD3Wgj0_N0cdpmkN9k1S7PRmQLvTBoqaqmW19alkSk8QylYcw20lQ2NLkcj2z87bE6YpEid1_5-_YhM-3a7GScz14 Apr 18 16:25:23 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:25:23 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:25:23 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:25:23 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:25:23 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:25:23 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:25:23 user devstack@n-api.service[61295]: X-Project-Id: 5695adbb14ea4162bc40547b1509a1e4 Apr 18 16:25:23 user devstack@n-api.service[61295]: X-Project-Name: tempest-ServersNegativeTestJSON-1696086909 Apr 18 16:25:23 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:25:23 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:25:23 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5695adbb14ea4162bc40547b1509a1e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5695adbb14ea4162bc40547b1509a1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5695adbb14ea4162bc40547b1509a1e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:25:23 user devstack@n-api.service[61295]: X-Tenant: tempest-ServersNegativeTestJSON-1696086909 Apr 18 16:25:23 user devstack@n-api.service[61295]: X-Tenant-Id: 5695adbb14ea4162bc40547b1509a1e4 Apr 18 16:25:23 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1696086909 Apr 18 16:25:23 user devstack@n-api.service[61295]: X-User: tempest-ServersNegativeTestJSON-1696086909-project-member Apr 18 16:25:23 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:25:23 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:25:23 user devstack@n-api.service[61295]: X-User-Id: 2963911de4f34d79816a9a1f9ad24a27 Apr 18 16:25:23 user devstack@n-api.service[61295]: X-User-Name: tempest-ServersNegativeTestJSON-1696086909-project-member Apr 18 16:25:23 user devstack@n-api.service[61295]: method: > Apr 18 16:25:23 user devstack@n-api.service[61295]: exception: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. Apr 18 16:25:23 user devstack@n-api.service[61295]: action_args: {'id': 'a4febff2-74e8-47ef-820d-f407a4d22d9d'} Apr 18 16:25:23 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. Apr 18 16:25:23 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:25:23 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-9435b9e2-51e3-49f5-a29f-9dd459770a3e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Returning 404 to user: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:25:23 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-9435b9e2-51e3-49f5-a29f-9dd459770a3e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d" status: 404 len: 111 microversion: 2.1 time: 0.035520 Apr 18 16:25:23 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 139/410] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:25:23 2023] GET /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:25:23 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:25:23 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=6 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:25:23 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:25:23 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=4 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:25:23 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-7ae2ddff-4a8d-4c59-b887-7705c5b9f15b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:25:23 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-7ae2ddff-4a8d-4c59-b887-7705c5b9f15b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: 66df9389-d007-4737-8bb1-55bcb5f227ff] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:25:23 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-7ae2ddff-4a8d-4c59-b887-7705c5b9f15b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:23 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-7ae2ddff-4a8d-4c59-b887-7705c5b9f15b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:23 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-7ae2ddff-4a8d-4c59-b887-7705c5b9f15b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:23 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-7ae2ddff-4a8d-4c59-b887-7705c5b9f15b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:23 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-7ae2ddff-4a8d-4c59-b887-7705c5b9f15b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:23 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-7ae2ddff-4a8d-4c59-b887-7705c5b9f15b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:23 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-7ae2ddff-4a8d-4c59-b887-7705c5b9f15b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2963911de4f34d79816a9a1f9ad24a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5695adbb14ea4162bc40547b1509a1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:25:23 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-7ae2ddff-4a8d-4c59-b887-7705c5b9f15b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff" status: 200 len: 1495 microversion: 2.1 time: 0.211706 Apr 18 16:25:23 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 138/411] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:25:23 2023] GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff => generated 1495 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-acce3281-b862-406a-890b-2c9d8d3b969c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-acce3281-b862-406a-890b-2c9d8d3b969c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=8 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-acce3281-b862-406a-890b-2c9d8d3b969c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-acce3281-b862-406a-890b-2c9d8d3b969c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-acce3281-b862-406a-890b-2c9d8d3b969c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-acce3281-b862-406a-890b-2c9d8d3b969c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-acce3281-b862-406a-890b-2c9d8d3b969c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-acce3281-b862-406a-890b-2c9d8d3b969c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-acce3281-b862-406a-890b-2c9d8d3b969c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-acce3281-b862-406a-890b-2c9d8d3b969c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-acce3281-b862-406a-890b-2c9d8d3b969c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG nova.objects.instance [None req-acce3281-b862-406a-890b-2c9d8d3b969c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lazy-loading 'fault' on Instance uuid 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b {{(pid=61296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-acce3281-b862-406a-890b-2c9d8d3b969c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-acce3281-b862-406a-890b-2c9d8d3b969c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:25:38 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-acce3281-b862-406a-890b-2c9d8d3b969c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:25:38 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-acce3281-b862-406a-890b-2c9d8d3b969c tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50137f3d-a6c4-4ac5-8edb-fd5941f4e43b" status: 200 len: 1650 microversion: 2.87 time: 0.111558 Apr 18 16:25:38 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 135/412] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:25:38 2023] GET /compute/v2.1/servers/50137f3d-a6c4-4ac5-8edb-fd5941f4e43b => generated 1650 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b] Going to try to terminate instance {{(pid=61295) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b] Doing local delete in cell 81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4(cell1) {{(pid=61295) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:38 user devstack@n-api.service[61295]: WARNING nova.compute.api [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b] instance's host None is down, deleting from database Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG nova.network.neutron [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b] deallocate_for_instance() {{(pid=61295) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG nova.network.neutron [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b] Instance cache missing network info. {{(pid=61295) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG nova.network.neutron [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b] Updating instance_info_cache with network_info: [] {{(pid=61295) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 18 16:25:38 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61295) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 18 16:25:38 user devstack@n-api.service[61295]: WARNING nova.compute.api [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 18 16:25:38 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-efec1104-7494-4fce-a672-597014df19eb tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/50137f3d-a6c4-4ac5-8edb-fd5941f4e43b" status: 204 len: 0 microversion: 2.87 time: 0.457909 Apr 18 16:25:38 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 140/413] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 16:25:38 2023] DELETE /compute/v2.1/servers/50137f3d-a6c4-4ac5-8edb-fd5941f4e43b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 16:25:38 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:25:38 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=6 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:25:38 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-9a1bc73a-16be-4b80-90db-45a27920a92f tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:25:38 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-9a1bc73a-16be-4b80-90db-45a27920a92f tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:25:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-9a1bc73a-16be-4b80-90db-45a27920a92f tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-9a1bc73a-16be-4b80-90db-45a27920a92f tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-9a1bc73a-16be-4b80-90db-45a27920a92f tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-9a1bc73a-16be-4b80-90db-45a27920a92f tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-9a1bc73a-16be-4b80-90db-45a27920a92f tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:38 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-9a1bc73a-16be-4b80-90db-45a27920a92f tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:38 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-9a1bc73a-16be-4b80-90db-45a27920a92f tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] HTTP exception thrown: Instance 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b could not be found. Apr 18 16:25:38 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-9a1bc73a-16be-4b80-90db-45a27920a92f tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Request method failure captured: Apr 18 16:25:38 user devstack@n-api.service[61294]: request: GET /compute/v2.1/servers/50137f3d-a6c4-4ac5-8edb-fd5941f4e43b HTTP/1.1 Apr 18 16:25:38 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:25:38 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:25:38 user devstack@n-api.service[61294]: Connection: close Apr 18 16:25:38 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:25:38 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:25:38 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:25:38 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:25:38 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:25:38 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsK2urU6zpYqUryz6kjpRn_xfxcKxINV1Fl_rLQYN2scVWoJVqIsK36YQ3bNyjICQcU8HREYr_ExKMh5uXEcfyIW1BrC1Xqz8VwomDMYtvOQk2GnF-AFhsloFkL0DmGDBdhjNiuaxvPgTkmTGjm-Y9koAadk2AwhEGpApMZnjVLcVrY Apr 18 16:25:38 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:25:38 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:25:38 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:25:38 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:25:38 user devstack@n-api.service[61294]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 16:25:38 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:25:38 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:25:38 user devstack@n-api.service[61294]: X-Project-Id: f516f5ec45ca4508841c77f79e8c038b Apr 18 16:25:38 user devstack@n-api.service[61294]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2021464272 Apr 18 16:25:38 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:25:38 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:25:38 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f516f5ec45ca4508841c77f79e8c038b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f516f5ec45ca4508841c77f79e8c038b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f516f5ec45ca4508841c77f79e8c038b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:25:38 user devstack@n-api.service[61294]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2021464272 Apr 18 16:25:38 user devstack@n-api.service[61294]: X-Tenant-Id: f516f5ec45ca4508841c77f79e8c038b Apr 18 16:25:38 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2021464272 Apr 18 16:25:38 user devstack@n-api.service[61294]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member Apr 18 16:25:38 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:25:38 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:25:38 user devstack@n-api.service[61294]: X-User-Id: c54c277689214bd0a2cadb1e2ac288a9 Apr 18 16:25:38 user devstack@n-api.service[61294]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member Apr 18 16:25:38 user devstack@n-api.service[61294]: method: > Apr 18 16:25:38 user devstack@n-api.service[61294]: exception: Instance 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b could not be found. Apr 18 16:25:38 user devstack@n-api.service[61294]: action_args: {'id': '50137f3d-a6c4-4ac5-8edb-fd5941f4e43b'} Apr 18 16:25:38 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b could not be found. Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b could not be found. Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b could not be found. Apr 18 16:25:38 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:25:38 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-9a1bc73a-16be-4b80-90db-45a27920a92f tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Returning 404 to user: Instance 50137f3d-a6c4-4ac5-8edb-fd5941f4e43b could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:25:38 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-9a1bc73a-16be-4b80-90db-45a27920a92f tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50137f3d-a6c4-4ac5-8edb-fd5941f4e43b" status: 404 len: 111 microversion: 2.87 time: 0.033819 Apr 18 16:25:38 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 139/414] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:25:38 2023] GET /compute/v2.1/servers/50137f3d-a6c4-4ac5-8edb-fd5941f4e43b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 16:25:39 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-7e5e4c70-5a78-4556-b16e-d2f033fbe1a7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:25:39 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-7e5e4c70-5a78-4556-b16e-d2f033fbe1a7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:25:39 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7e5e4c70-5a78-4556-b16e-d2f033fbe1a7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:39 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7e5e4c70-5a78-4556-b16e-d2f033fbe1a7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:39 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7e5e4c70-5a78-4556-b16e-d2f033fbe1a7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:39 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7e5e4c70-5a78-4556-b16e-d2f033fbe1a7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:39 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7e5e4c70-5a78-4556-b16e-d2f033fbe1a7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:39 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-7e5e4c70-5a78-4556-b16e-d2f033fbe1a7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:39 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-7e5e4c70-5a78-4556-b16e-d2f033fbe1a7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2] Going to try to terminate instance {{(pid=61296) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:25:39 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-7e5e4c70-5a78-4556-b16e-d2f033fbe1a7 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6aece7dd-d545-4e26-9cb7-30ee0b01ebb2" status: 204 len: 0 microversion: 2.87 time: 0.107629 Apr 18 16:25:39 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 136/415] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 16:25:39 2023] DELETE /compute/v2.1/servers/6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 16:25:39 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-e4f884fe-1126-4d33-ae58-8406b80befe9 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:25:39 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-e4f884fe-1126-4d33-ae58-8406b80befe9 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:25:39 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e4f884fe-1126-4d33-ae58-8406b80befe9 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:39 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e4f884fe-1126-4d33-ae58-8406b80befe9 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:39 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e4f884fe-1126-4d33-ae58-8406b80befe9 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:39 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e4f884fe-1126-4d33-ae58-8406b80befe9 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:39 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e4f884fe-1126-4d33-ae58-8406b80befe9 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:39 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-e4f884fe-1126-4d33-ae58-8406b80befe9 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:39 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-e4f884fe-1126-4d33-ae58-8406b80befe9 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:25:39 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-e4f884fe-1126-4d33-ae58-8406b80befe9 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:25:39 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-e4f884fe-1126-4d33-ae58-8406b80befe9 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:25:39 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-e4f884fe-1126-4d33-ae58-8406b80befe9 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6aece7dd-d545-4e26-9cb7-30ee0b01ebb2" status: 200 len: 1697 microversion: 2.87 time: 0.305520 Apr 18 16:25:39 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 141/416] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:25:39 2023] GET /compute/v2.1/servers/6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 => generated 1697 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:25:39 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-11ad094a-40ba-4be6-92a3-d0e430786109 req-fb97c8ff-5f1f-4861-a2f0-62f996377a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aece7dd-d545-4e26-9cb7-30ee0b01ebb2", "name": "network-vif-unplugged", "status": "completed", "tag": "8d71cc71-9d8c-428d-ad04-69a31a967fe9"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:25:39 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-11ad094a-40ba-4be6-92a3-d0e430786109 req-fb97c8ff-5f1f-4861-a2f0-62f996377a37 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:39 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-11ad094a-40ba-4be6-92a3-d0e430786109 req-fb97c8ff-5f1f-4861-a2f0-62f996377a37 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:39 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-11ad094a-40ba-4be6-92a3-d0e430786109 req-fb97c8ff-5f1f-4861-a2f0-62f996377a37 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:39 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-11ad094a-40ba-4be6-92a3-d0e430786109 req-fb97c8ff-5f1f-4861-a2f0-62f996377a37 service nova] Creating event network-vif-unplugged:8d71cc71-9d8c-428d-ad04-69a31a967fe9 for instance 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 on user Apr 18 16:25:39 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-11ad094a-40ba-4be6-92a3-d0e430786109 req-fb97c8ff-5f1f-4861-a2f0-62f996377a37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.168405 Apr 18 16:25:39 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 140/417] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:25:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:25:40 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-d3e7bf06-fedb-449f-95a4-7f3a0993505b req-49e3decd-d600-4497-98d8-17b267dc0216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aece7dd-d545-4e26-9cb7-30ee0b01ebb2", "name": "network-vif-deleted", "tag": "8d71cc71-9d8c-428d-ad04-69a31a967fe9"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:25:40 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-d3e7bf06-fedb-449f-95a4-7f3a0993505b req-49e3decd-d600-4497-98d8-17b267dc0216 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:40 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-d3e7bf06-fedb-449f-95a4-7f3a0993505b req-49e3decd-d600-4497-98d8-17b267dc0216 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:40 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-d3e7bf06-fedb-449f-95a4-7f3a0993505b req-49e3decd-d600-4497-98d8-17b267dc0216 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:40 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-d3e7bf06-fedb-449f-95a4-7f3a0993505b req-49e3decd-d600-4497-98d8-17b267dc0216 service nova] Creating event network-vif-deleted:8d71cc71-9d8c-428d-ad04-69a31a967fe9 for instance 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 on user Apr 18 16:25:40 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-d3e7bf06-fedb-449f-95a4-7f3a0993505b req-49e3decd-d600-4497-98d8-17b267dc0216 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030561 Apr 18 16:25:40 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 137/418] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:25:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:25:41 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-277daca2-5e47-4581-865e-8149c6022f17 req-b20b6e66-dcfc-465d-8c04-c485ba1ed482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aece7dd-d545-4e26-9cb7-30ee0b01ebb2", "name": "network-vif-plugged", "status": "completed", "tag": "8d71cc71-9d8c-428d-ad04-69a31a967fe9"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:25:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-277daca2-5e47-4581-865e-8149c6022f17 req-b20b6e66-dcfc-465d-8c04-c485ba1ed482 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-277daca2-5e47-4581-865e-8149c6022f17 req-b20b6e66-dcfc-465d-8c04-c485ba1ed482 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-277daca2-5e47-4581-865e-8149c6022f17 req-b20b6e66-dcfc-465d-8c04-c485ba1ed482 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:41 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-277daca2-5e47-4581-865e-8149c6022f17 req-b20b6e66-dcfc-465d-8c04-c485ba1ed482 service nova] Creating event network-vif-plugged:8d71cc71-9d8c-428d-ad04-69a31a967fe9 for instance 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 on user Apr 18 16:25:41 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-277daca2-5e47-4581-865e-8149c6022f17 req-b20b6e66-dcfc-465d-8c04-c485ba1ed482 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027184 Apr 18 16:25:41 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 142/419] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:25:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:25:48 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-5e339194-cf7f-4575-8a3f-d6ad728feb4a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:25:48 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-5e339194-cf7f-4575-8a3f-d6ad728feb4a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 776d1402-3e8a-407d-a20d-db46c1a21b23] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:25:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5e339194-cf7f-4575-8a3f-d6ad728feb4a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5e339194-cf7f-4575-8a3f-d6ad728feb4a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5e339194-cf7f-4575-8a3f-d6ad728feb4a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5e339194-cf7f-4575-8a3f-d6ad728feb4a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5e339194-cf7f-4575-8a3f-d6ad728feb4a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:48 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-5e339194-cf7f-4575-8a3f-d6ad728feb4a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:48 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-5e339194-cf7f-4575-8a3f-d6ad728feb4a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add4c9d906ba49a590f203e0aa98ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4b993c13b46ea8f80b0caed60a373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:25:48 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-5e339194-cf7f-4575-8a3f-d6ad728feb4a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "GET /compute/v2.1/servers/776d1402-3e8a-407d-a20d-db46c1a21b23" status: 200 len: 1538 microversion: 2.1 time: 0.211706 Apr 18 16:25:48 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 141/420] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:25:48 2023] GET /compute/v2.1/servers/776d1402-3e8a-407d-a20d-db46c1a21b23 => generated 1538 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:25:48 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-328f8694-3c79-46ac-8c0c-d683c447a45b tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:25:48 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-328f8694-3c79-46ac-8c0c-d683c447a45b tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'add4c9d906ba49a590f203e0aa98ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4b993c13b46ea8f80b0caed60a373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:25:48 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-328f8694-3c79-46ac-8c0c-d683c447a45b tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Searching by: {'deleted': False, 'project_id': '00d4b993c13b46ea8f80b0caed60a373'} {{(pid=61296) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 18 16:25:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-328f8694-3c79-46ac-8c0c-d683c447a45b tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-328f8694-3c79-46ac-8c0c-d683c447a45b tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-328f8694-3c79-46ac-8c0c-d683c447a45b tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-328f8694-3c79-46ac-8c0c-d683c447a45b tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-328f8694-3c79-46ac-8c0c-d683c447a45b tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:48 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-328f8694-3c79-46ac-8c0c-d683c447a45b tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:48 user devstack@n-api.service[61296]: DEBUG nova.compute.multi_cell_list [None req-328f8694-3c79-46ac-8c0c-d683c447a45b tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61296) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 18 16:25:48 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-328f8694-3c79-46ac-8c0c-d683c447a45b tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.185211 Apr 18 16:25:48 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 138/421] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 18 16:25:48 2023] GET /compute/v2.1/servers => generated 341 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:25:48 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-cb0a889f-1483-4db8-9523-35f493ff8063 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:25:48 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-cb0a889f-1483-4db8-9523-35f493ff8063 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 776d1402-3e8a-407d-a20d-db46c1a21b23] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:25:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-cb0a889f-1483-4db8-9523-35f493ff8063 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-cb0a889f-1483-4db8-9523-35f493ff8063 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-cb0a889f-1483-4db8-9523-35f493ff8063 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-cb0a889f-1483-4db8-9523-35f493ff8063 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-cb0a889f-1483-4db8-9523-35f493ff8063 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:48 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-cb0a889f-1483-4db8-9523-35f493ff8063 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:49 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-cb0a889f-1483-4db8-9523-35f493ff8063 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add4c9d906ba49a590f203e0aa98ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4b993c13b46ea8f80b0caed60a373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:25:49 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-cb0a889f-1483-4db8-9523-35f493ff8063 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "GET /compute/v2.1/servers/776d1402-3e8a-407d-a20d-db46c1a21b23" status: 200 len: 1538 microversion: 2.1 time: 0.217146 Apr 18 16:25:49 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 143/422] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:25:48 2023] GET /compute/v2.1/servers/776d1402-3e8a-407d-a20d-db46c1a21b23 => generated 1538 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:25:50 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-64ed6fdb-c332-4a79-88a0-0684cf7144a8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:25:50 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-64ed6fdb-c332-4a79-88a0-0684cf7144a8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 776d1402-3e8a-407d-a20d-db46c1a21b23] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:25:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-64ed6fdb-c332-4a79-88a0-0684cf7144a8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-64ed6fdb-c332-4a79-88a0-0684cf7144a8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-64ed6fdb-c332-4a79-88a0-0684cf7144a8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-64ed6fdb-c332-4a79-88a0-0684cf7144a8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-64ed6fdb-c332-4a79-88a0-0684cf7144a8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:50 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-64ed6fdb-c332-4a79-88a0-0684cf7144a8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:50 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-64ed6fdb-c332-4a79-88a0-0684cf7144a8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 776d1402-3e8a-407d-a20d-db46c1a21b23] Going to try to terminate instance {{(pid=61294) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:25:50 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-64ed6fdb-c332-4a79-88a0-0684cf7144a8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/776d1402-3e8a-407d-a20d-db46c1a21b23" status: 204 len: 0 microversion: 2.1 time: 0.130532 Apr 18 16:25:50 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 142/423] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:25:50 2023] DELETE /compute/v2.1/servers/776d1402-3e8a-407d-a20d-db46c1a21b23 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:25:50 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-a909c206-e305-4918-aa0a-738071df118f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:25:50 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-a909c206-e305-4918-aa0a-738071df118f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 776d1402-3e8a-407d-a20d-db46c1a21b23] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:25:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a909c206-e305-4918-aa0a-738071df118f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a909c206-e305-4918-aa0a-738071df118f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a909c206-e305-4918-aa0a-738071df118f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a909c206-e305-4918-aa0a-738071df118f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a909c206-e305-4918-aa0a-738071df118f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:50 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a909c206-e305-4918-aa0a-738071df118f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:51 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-99491e90-3f29-4686-b08a-ae24ec3d1ba9 req-6e7957e6-efcc-45f6-adb6-625063eb1c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776d1402-3e8a-407d-a20d-db46c1a21b23", "name": "network-vif-unplugged", "status": "completed", "tag": "61df4fc4-1d98-4d7b-b74e-280c61eac6ee"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:25:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-99491e90-3f29-4686-b08a-ae24ec3d1ba9 req-6e7957e6-efcc-45f6-adb6-625063eb1c2a service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-99491e90-3f29-4686-b08a-ae24ec3d1ba9 req-6e7957e6-efcc-45f6-adb6-625063eb1c2a service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:51 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-99491e90-3f29-4686-b08a-ae24ec3d1ba9 req-6e7957e6-efcc-45f6-adb6-625063eb1c2a service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:51 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-a909c206-e305-4918-aa0a-738071df118f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add4c9d906ba49a590f203e0aa98ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4b993c13b46ea8f80b0caed60a373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:25:51 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-a909c206-e305-4918-aa0a-738071df118f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "GET /compute/v2.1/servers/776d1402-3e8a-407d-a20d-db46c1a21b23" status: 200 len: 1544 microversion: 2.1 time: 0.293465 Apr 18 16:25:51 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 139/424] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:25:50 2023] GET /compute/v2.1/servers/776d1402-3e8a-407d-a20d-db46c1a21b23 => generated 1544 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 16:25:51 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-99491e90-3f29-4686-b08a-ae24ec3d1ba9 req-6e7957e6-efcc-45f6-adb6-625063eb1c2a service nova] Creating event network-vif-unplugged:61df4fc4-1d98-4d7b-b74e-280c61eac6ee for instance 776d1402-3e8a-407d-a20d-db46c1a21b23 on user Apr 18 16:25:51 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-99491e90-3f29-4686-b08a-ae24ec3d1ba9 req-6e7957e6-efcc-45f6-adb6-625063eb1c2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098226 Apr 18 16:25:51 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 144/425] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:25:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:25:51 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-08aabf67-5813-40f2-9d17-9e08731fa7bc req-75258900-5e32-480b-870d-a02c56642eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776d1402-3e8a-407d-a20d-db46c1a21b23", "name": "network-vif-deleted", "tag": "61df4fc4-1d98-4d7b-b74e-280c61eac6ee"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:25:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-08aabf67-5813-40f2-9d17-9e08731fa7bc req-75258900-5e32-480b-870d-a02c56642eea service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-08aabf67-5813-40f2-9d17-9e08731fa7bc req-75258900-5e32-480b-870d-a02c56642eea service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:51 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-08aabf67-5813-40f2-9d17-9e08731fa7bc req-75258900-5e32-480b-870d-a02c56642eea service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:51 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-08aabf67-5813-40f2-9d17-9e08731fa7bc req-75258900-5e32-480b-870d-a02c56642eea service nova] Creating event network-vif-deleted:61df4fc4-1d98-4d7b-b74e-280c61eac6ee for instance 776d1402-3e8a-407d-a20d-db46c1a21b23 on user Apr 18 16:25:51 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-08aabf67-5813-40f2-9d17-9e08731fa7bc req-75258900-5e32-480b-870d-a02c56642eea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026419 Apr 18 16:25:51 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 143/426] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:25:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:25:53 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-d3dd5b4c-084e-43f3-a6c6-7acf5c12d433 req-eed0e65a-b9be-47aa-9aa5-4dbde6cfa381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776d1402-3e8a-407d-a20d-db46c1a21b23", "name": "network-vif-plugged", "status": "completed", "tag": "61df4fc4-1d98-4d7b-b74e-280c61eac6ee"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:25:53 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-d3dd5b4c-084e-43f3-a6c6-7acf5c12d433 req-eed0e65a-b9be-47aa-9aa5-4dbde6cfa381 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:25:53 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-d3dd5b4c-084e-43f3-a6c6-7acf5c12d433 req-eed0e65a-b9be-47aa-9aa5-4dbde6cfa381 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:25:53 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-d3dd5b4c-084e-43f3-a6c6-7acf5c12d433 req-eed0e65a-b9be-47aa-9aa5-4dbde6cfa381 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:25:53 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-d3dd5b4c-084e-43f3-a6c6-7acf5c12d433 req-eed0e65a-b9be-47aa-9aa5-4dbde6cfa381 service nova] Creating event network-vif-plugged:61df4fc4-1d98-4d7b-b74e-280c61eac6ee for instance 776d1402-3e8a-407d-a20d-db46c1a21b23 on user Apr 18 16:25:53 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-d3dd5b4c-084e-43f3-a6c6-7acf5c12d433 req-eed0e65a-b9be-47aa-9aa5-4dbde6cfa381 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027632 Apr 18 16:25:53 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 140/427] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:25:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:26:25 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:26:25 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:26:25 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-60745230-b449-4362-a8fb-49a65f0ce24b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:26:25 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-60745230-b449-4362-a8fb-49a65f0ce24b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: 66df9389-d007-4737-8bb1-55bcb5f227ff] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:26:25 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-60745230-b449-4362-a8fb-49a65f0ce24b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:25 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-60745230-b449-4362-a8fb-49a65f0ce24b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:25 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-60745230-b449-4362-a8fb-49a65f0ce24b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:25 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-60745230-b449-4362-a8fb-49a65f0ce24b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:25 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-60745230-b449-4362-a8fb-49a65f0ce24b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:25 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-60745230-b449-4362-a8fb-49a65f0ce24b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:25 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-60745230-b449-4362-a8fb-49a65f0ce24b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2963911de4f34d79816a9a1f9ad24a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5695adbb14ea4162bc40547b1509a1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:26:25 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-60745230-b449-4362-a8fb-49a65f0ce24b tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff" status: 200 len: 1495 microversion: 2.1 time: 0.291409 Apr 18 16:26:25 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 145/428] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:26:25 2023] GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff => generated 1495 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:26:29 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:26:29 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:26:29 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-c86ae951-798b-4bcd-b61f-827c1d6345b6 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:26:29 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-c86ae951-798b-4bcd-b61f-827c1d6345b6 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:26:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c86ae951-798b-4bcd-b61f-827c1d6345b6 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c86ae951-798b-4bcd-b61f-827c1d6345b6 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c86ae951-798b-4bcd-b61f-827c1d6345b6 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c86ae951-798b-4bcd-b61f-827c1d6345b6 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c86ae951-798b-4bcd-b61f-827c1d6345b6 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:29 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c86ae951-798b-4bcd-b61f-827c1d6345b6 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:29 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-c86ae951-798b-4bcd-b61f-827c1d6345b6 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] HTTP exception thrown: Instance 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 could not be found. Apr 18 16:26:29 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-c86ae951-798b-4bcd-b61f-827c1d6345b6 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Request method failure captured: Apr 18 16:26:29 user devstack@n-api.service[61294]: request: GET /compute/v2.1/servers/6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 HTTP/1.1 Apr 18 16:26:29 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:26:29 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:26:29 user devstack@n-api.service[61294]: Connection: close Apr 18 16:26:29 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:26:29 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:26:29 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:26:29 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:26:29 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:26:29 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsK2urU6zpYqUryz6kjpRn_xfxcKxINV1Fl_rLQYN2scVWoJVqIsK36YQ3bNyjICQcU8HREYr_ExKMh5uXEcfyIW1BrC1Xqz8VwomDMYtvOQk2GnF-AFhsloFkL0DmGDBdhjNiuaxvPgTkmTGjm-Y9koAadk2AwhEGpApMZnjVLcVrY Apr 18 16:26:29 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:26:29 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:26:29 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:26:29 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:26:29 user devstack@n-api.service[61294]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 16:26:29 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:26:29 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:26:29 user devstack@n-api.service[61294]: X-Project-Id: f516f5ec45ca4508841c77f79e8c038b Apr 18 16:26:29 user devstack@n-api.service[61294]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2021464272 Apr 18 16:26:29 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:26:29 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:26:29 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f516f5ec45ca4508841c77f79e8c038b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f516f5ec45ca4508841c77f79e8c038b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f516f5ec45ca4508841c77f79e8c038b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:26:29 user devstack@n-api.service[61294]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2021464272 Apr 18 16:26:29 user devstack@n-api.service[61294]: X-Tenant-Id: f516f5ec45ca4508841c77f79e8c038b Apr 18 16:26:29 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2021464272 Apr 18 16:26:29 user devstack@n-api.service[61294]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member Apr 18 16:26:29 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:26:29 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:26:29 user devstack@n-api.service[61294]: X-User-Id: c54c277689214bd0a2cadb1e2ac288a9 Apr 18 16:26:29 user devstack@n-api.service[61294]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member Apr 18 16:26:29 user devstack@n-api.service[61294]: method: > Apr 18 16:26:29 user devstack@n-api.service[61294]: exception: Instance 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 could not be found. Apr 18 16:26:29 user devstack@n-api.service[61294]: action_args: {'id': '6aece7dd-d545-4e26-9cb7-30ee0b01ebb2'} Apr 18 16:26:29 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 could not be found. Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 could not be found. Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 could not be found. Apr 18 16:26:29 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:26:29 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-c86ae951-798b-4bcd-b61f-827c1d6345b6 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Returning 404 to user: Instance 6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:26:29 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-c86ae951-798b-4bcd-b61f-827c1d6345b6 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6aece7dd-d545-4e26-9cb7-30ee0b01ebb2" status: 404 len: 111 microversion: 2.87 time: 0.037461 Apr 18 16:26:29 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 144/429] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:26:29 2023] GET /compute/v2.1/servers/6aece7dd-d545-4e26-9cb7-30ee0b01ebb2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 16:26:29 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:26:29 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:26:29 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:26:29 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-a8590daf-08a5-43ba-affc-5031b86feab3 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:26:29 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-a8590daf-08a5-43ba-affc-5031b86feab3 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6528f05a-9f05-4f35-b991-687e4f47029e] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:26:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a8590daf-08a5-43ba-affc-5031b86feab3 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a8590daf-08a5-43ba-affc-5031b86feab3 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a8590daf-08a5-43ba-affc-5031b86feab3 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a8590daf-08a5-43ba-affc-5031b86feab3 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a8590daf-08a5-43ba-affc-5031b86feab3 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:29 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-a8590daf-08a5-43ba-affc-5031b86feab3 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:30 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-a8590daf-08a5-43ba-affc-5031b86feab3 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6528f05a-9f05-4f35-b991-687e4f47029e] Going to try to terminate instance {{(pid=61296) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:26:30 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-a8590daf-08a5-43ba-affc-5031b86feab3 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6528f05a-9f05-4f35-b991-687e4f47029e" status: 204 len: 0 microversion: 2.87 time: 0.139908 Apr 18 16:26:30 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 141/430] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 16:26:29 2023] DELETE /compute/v2.1/servers/6528f05a-9f05-4f35-b991-687e4f47029e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 16:26:30 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-c5d3b2c8-817f-419a-b57e-837db6a0777b tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:26:30 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-c5d3b2c8-817f-419a-b57e-837db6a0777b tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6528f05a-9f05-4f35-b991-687e4f47029e] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:26:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-c5d3b2c8-817f-419a-b57e-837db6a0777b tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-c5d3b2c8-817f-419a-b57e-837db6a0777b tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-c5d3b2c8-817f-419a-b57e-837db6a0777b tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-c5d3b2c8-817f-419a-b57e-837db6a0777b tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-c5d3b2c8-817f-419a-b57e-837db6a0777b tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-c5d3b2c8-817f-419a-b57e-837db6a0777b tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:30 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-6561f61d-c823-44cf-9946-a6ec7054f8e5 req-3f5e87c5-01ac-44e3-bed7-82197f0d6e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6528f05a-9f05-4f35-b991-687e4f47029e", "name": "network-vif-unplugged", "status": "completed", "tag": "08164ae1-ace4-4d80-ad79-1741eacfa16e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:26:30 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-6561f61d-c823-44cf-9946-a6ec7054f8e5 req-3f5e87c5-01ac-44e3-bed7-82197f0d6e6e service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:30 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-6561f61d-c823-44cf-9946-a6ec7054f8e5 req-3f5e87c5-01ac-44e3-bed7-82197f0d6e6e service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:30 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-6561f61d-c823-44cf-9946-a6ec7054f8e5 req-3f5e87c5-01ac-44e3-bed7-82197f0d6e6e service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:30 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-6561f61d-c823-44cf-9946-a6ec7054f8e5 req-3f5e87c5-01ac-44e3-bed7-82197f0d6e6e service nova] Creating event network-vif-unplugged:08164ae1-ace4-4d80-ad79-1741eacfa16e for instance 6528f05a-9f05-4f35-b991-687e4f47029e on user Apr 18 16:26:30 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-6561f61d-c823-44cf-9946-a6ec7054f8e5 req-3f5e87c5-01ac-44e3-bed7-82197f0d6e6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029608 Apr 18 16:26:30 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 145/431] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:26:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:26:30 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-c5d3b2c8-817f-419a-b57e-837db6a0777b tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:26:30 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-c5d3b2c8-817f-419a-b57e-837db6a0777b tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:26:30 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-c5d3b2c8-817f-419a-b57e-837db6a0777b tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c54c277689214bd0a2cadb1e2ac288a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f516f5ec45ca4508841c77f79e8c038b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:26:30 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-c5d3b2c8-817f-419a-b57e-837db6a0777b tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6528f05a-9f05-4f35-b991-687e4f47029e" status: 200 len: 1697 microversion: 2.87 time: 0.461731 Apr 18 16:26:30 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 146/432] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:26:30 2023] GET /compute/v2.1/servers/6528f05a-9f05-4f35-b991-687e4f47029e => generated 1697 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 16:26:31 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-8c8daf74-c039-4f73-be87-9a1be3e9d8cf req-f4a9d65b-34be-4e10-bcff-80553a91b7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6528f05a-9f05-4f35-b991-687e4f47029e", "name": "network-vif-deleted", "tag": "08164ae1-ace4-4d80-ad79-1741eacfa16e"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:26:31 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-8c8daf74-c039-4f73-be87-9a1be3e9d8cf req-f4a9d65b-34be-4e10-bcff-80553a91b7e1 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:31 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-8c8daf74-c039-4f73-be87-9a1be3e9d8cf req-f4a9d65b-34be-4e10-bcff-80553a91b7e1 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:31 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-8c8daf74-c039-4f73-be87-9a1be3e9d8cf req-f4a9d65b-34be-4e10-bcff-80553a91b7e1 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:31 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-8c8daf74-c039-4f73-be87-9a1be3e9d8cf req-f4a9d65b-34be-4e10-bcff-80553a91b7e1 service nova] Creating event network-vif-deleted:08164ae1-ace4-4d80-ad79-1741eacfa16e for instance 6528f05a-9f05-4f35-b991-687e4f47029e on user Apr 18 16:26:31 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-8c8daf74-c039-4f73-be87-9a1be3e9d8cf req-f4a9d65b-34be-4e10-bcff-80553a91b7e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027860 Apr 18 16:26:31 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 142/433] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:26:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:26:32 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-58c294dd-f772-4fef-b180-50d28c08c7ce req-b467f45d-24fb-47a2-8af0-beb8e67136e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6528f05a-9f05-4f35-b991-687e4f47029e", "name": "network-vif-plugged", "status": "completed", "tag": "08164ae1-ace4-4d80-ad79-1741eacfa16e"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:26:32 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-58c294dd-f772-4fef-b180-50d28c08c7ce req-b467f45d-24fb-47a2-8af0-beb8e67136e5 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:32 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-58c294dd-f772-4fef-b180-50d28c08c7ce req-b467f45d-24fb-47a2-8af0-beb8e67136e5 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:32 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-58c294dd-f772-4fef-b180-50d28c08c7ce req-b467f45d-24fb-47a2-8af0-beb8e67136e5 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:32 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-58c294dd-f772-4fef-b180-50d28c08c7ce req-b467f45d-24fb-47a2-8af0-beb8e67136e5 service nova] Creating event network-vif-plugged:08164ae1-ace4-4d80-ad79-1741eacfa16e for instance 6528f05a-9f05-4f35-b991-687e4f47029e on user Apr 18 16:26:32 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-58c294dd-f772-4fef-b180-50d28c08c7ce req-b467f45d-24fb-47a2-8af0-beb8e67136e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030496 Apr 18 16:26:32 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 146/434] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:26:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:26:41 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-0d7d798b-17d2-46a6-bf0b-acfa778f98a0 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:26:41 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-0d7d798b-17d2-46a6-bf0b-acfa778f98a0 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 776d1402-3e8a-407d-a20d-db46c1a21b23] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:26:41 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=12 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:26:41 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=6 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:26:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0d7d798b-17d2-46a6-bf0b-acfa778f98a0 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0d7d798b-17d2-46a6-bf0b-acfa778f98a0 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0d7d798b-17d2-46a6-bf0b-acfa778f98a0 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0d7d798b-17d2-46a6-bf0b-acfa778f98a0 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0d7d798b-17d2-46a6-bf0b-acfa778f98a0 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:41 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0d7d798b-17d2-46a6-bf0b-acfa778f98a0 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:41 user devstack@n-api.service[61295]: INFO nova.api.openstack.wsgi [None req-0d7d798b-17d2-46a6-bf0b-acfa778f98a0 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] HTTP exception thrown: Instance 776d1402-3e8a-407d-a20d-db46c1a21b23 could not be found. Apr 18 16:26:41 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-0d7d798b-17d2-46a6-bf0b-acfa778f98a0 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Request method failure captured: Apr 18 16:26:41 user devstack@n-api.service[61295]: request: GET /compute/v2.1/servers/776d1402-3e8a-407d-a20d-db46c1a21b23 HTTP/1.1 Apr 18 16:26:41 user devstack@n-api.service[61295]: Accept: application/json Apr 18 16:26:41 user devstack@n-api.service[61295]: Accept-Encoding: identity Apr 18 16:26:41 user devstack@n-api.service[61295]: Connection: close Apr 18 16:26:41 user devstack@n-api.service[61295]: Content-Length: 0 Apr 18 16:26:41 user devstack@n-api.service[61295]: Content-Type: application/json Apr 18 16:26:41 user devstack@n-api.service[61295]: Host: 10.0.0.210 Apr 18 16:26:41 user devstack@n-api.service[61295]: Openstack-System-Scope: None Apr 18 16:26:41 user devstack@n-api.service[61295]: User-Agent: python-urllib3/1.26.15 Apr 18 16:26:41 user devstack@n-api.service[61295]: X-Auth-Token: gAAAAABkPsQREe0C10OrZt7V2hmQPkE1ccpQJK6JY0xIGHNjPwGvkuAM93tO0c78v5YDrfR7eRDwXFSiC-feyB6TpfRIoYbwRDevmRstZb-6khUDRlO_16nNhU8JtVkPIZoGEUXzabIyXgmvf9qKYA6Ws56tnhbSwpUR_gLKrTO4K3Lr_zYYKzk Apr 18 16:26:41 user devstack@n-api.service[61295]: X-Domain-Id: None Apr 18 16:26:41 user devstack@n-api.service[61295]: X-Domain-Name: None Apr 18 16:26:41 user devstack@n-api.service[61295]: X-Identity-Status: Confirmed Apr 18 16:26:41 user devstack@n-api.service[61295]: X-Is-Admin-Project: True Apr 18 16:26:41 user devstack@n-api.service[61295]: X-Project-Domain-Id: default Apr 18 16:26:41 user devstack@n-api.service[61295]: X-Project-Domain-Name: Default Apr 18 16:26:41 user devstack@n-api.service[61295]: X-Project-Id: 00d4b993c13b46ea8f80b0caed60a373 Apr 18 16:26:41 user devstack@n-api.service[61295]: X-Project-Name: tempest-TestMinimumBasicScenario-386776323 Apr 18 16:26:41 user devstack@n-api.service[61295]: X-Role: reader,member Apr 18 16:26:41 user devstack@n-api.service[61295]: X-Roles: reader,member Apr 18 16:26:41 user devstack@n-api.service[61295]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/00d4b993c13b46ea8f80b0caed60a373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/00d4b993c13b46ea8f80b0caed60a373"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/00d4b993c13b46ea8f80b0caed60a373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:26:41 user devstack@n-api.service[61295]: X-Tenant: tempest-TestMinimumBasicScenario-386776323 Apr 18 16:26:41 user devstack@n-api.service[61295]: X-Tenant-Id: 00d4b993c13b46ea8f80b0caed60a373 Apr 18 16:26:41 user devstack@n-api.service[61295]: X-Tenant-Name: tempest-TestMinimumBasicScenario-386776323 Apr 18 16:26:41 user devstack@n-api.service[61295]: X-User: tempest-TestMinimumBasicScenario-386776323-project-member Apr 18 16:26:41 user devstack@n-api.service[61295]: X-User-Domain-Id: default Apr 18 16:26:41 user devstack@n-api.service[61295]: X-User-Domain-Name: Default Apr 18 16:26:41 user devstack@n-api.service[61295]: X-User-Id: add4c9d906ba49a590f203e0aa98ab64 Apr 18 16:26:41 user devstack@n-api.service[61295]: X-User-Name: tempest-TestMinimumBasicScenario-386776323-project-member Apr 18 16:26:41 user devstack@n-api.service[61295]: method: > Apr 18 16:26:41 user devstack@n-api.service[61295]: exception: Instance 776d1402-3e8a-407d-a20d-db46c1a21b23 could not be found. Apr 18 16:26:41 user devstack@n-api.service[61295]: action_args: {'id': '776d1402-3e8a-407d-a20d-db46c1a21b23'} Apr 18 16:26:41 user devstack@n-api.service[61295]: {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 776d1402-3e8a-407d-a20d-db46c1a21b23 could not be found. Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 776d1402-3e8a-407d-a20d-db46c1a21b23 could not be found. Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 776d1402-3e8a-407d-a20d-db46c1a21b23 could not be found. Apr 18 16:26:41 user devstack@n-api.service[61295]: ERROR nova.api.openstack.wsgi Apr 18 16:26:41 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-0d7d798b-17d2-46a6-bf0b-acfa778f98a0 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Returning 404 to user: Instance 776d1402-3e8a-407d-a20d-db46c1a21b23 could not be found. {{(pid=61295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:26:41 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-0d7d798b-17d2-46a6-bf0b-acfa778f98a0 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "GET /compute/v2.1/servers/776d1402-3e8a-407d-a20d-db46c1a21b23" status: 404 len: 111 microversion: 2.1 time: 0.032347 Apr 18 16:26:41 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 147/435] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:26:41 2023] GET /compute/v2.1/servers/776d1402-3e8a-407d-a20d-db46c1a21b23 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:26:41 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-b076e960-9d34-4d8b-8003-90f69ec54ce5 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '.version_select at 0x7fd6c92dd360>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:26:41 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-b076e960-9d34-4d8b-8003-90f69ec54ce5 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1759395561" status: 202 len: 0 microversion: 2.1 time: 0.022147 Apr 18 16:26:41 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 143/436] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 18 16:26:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1759395561 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:26:43 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=6 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:26:43 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=6 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:26:43 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-2889dcf3-ced8-4460-aaae-f5153c0bbe6a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Action: 'create', calling method: .version_select at 0x7fd6c94e1bd0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1240941080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTjzjFXAU6TCf5cUZ4HAW/uTn6Y3TUbR85mBRl2+FlNM0NVwWI69f9l4ZtVvR9kFoEORm5vcNFscXnnbdpx5zWg+f/sXB25kjR5e5QBGQL42u3J1dK+/RPVXZi6Tm2BzQ=="}} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:26:43 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-2889dcf3-ced8-4460-aaae-f5153c0bbe6a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Getting quotas for project 00d4b993c13b46ea8f80b0caed60a373. Resources: {'key_pairs'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:26:43 user devstack@n-api.service[61294]: DEBUG nova.quota [None req-2889dcf3-ced8-4460-aaae-f5153c0bbe6a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Getting quotas for user add4c9d906ba49a590f203e0aa98ab64 and project 00d4b993c13b46ea8f80b0caed60a373. Resources: {'key_pairs'} {{(pid=61294) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:26:43 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-2889dcf3-ced8-4460-aaae-f5153c0bbe6a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050880 Apr 18 16:26:43 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 147/437] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 16:26:43 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:26:43 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-645939165", "imageRef": "ec984284-e2e2-460c-8d57-fd257eb433e3", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1240941080", "networks": [{"uuid": "1cb85bc6-49f1-46be-91c8-d814b48c2a99"}]}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:26:43 user devstack@n-api.service[61295]: DEBUG nova.network.neutron [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] validate_networks() for [('1cb85bc6-49f1-46be-91c8-d814b48c2a99', None, None, None, None, None)] {{(pid=61295) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 16:26:44 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Flavor limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 16:26:44 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Image limits 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 16:26:44 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Flavor pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 16:26:44 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Image pref 0:0:0 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 16:26:44 user devstack@n-api.service[61295]: DEBUG nova.virt.hardware [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 16:26:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:44 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:44 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Getting quotas for project 00d4b993c13b46ea8f80b0caed60a373. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 16:26:44 user devstack@n-api.service[61295]: DEBUG nova.quota [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Getting quotas for user add4c9d906ba49a590f203e0aa98ab64 and project 00d4b993c13b46ea8f80b0caed60a373. Resources: {'cores', 'ram', 'instances'} {{(pid=61295) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 16:26:44 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Going to run 1 instances... {{(pid=61295) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 16:26:44 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 2e71dfcf-8ffe-47de-9922-ad5a01615168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ec984284-e2e2-460c-8d57-fd257eb433e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 16:26:44 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-afcec3f2-471b-4f08-a03e-8296da751340 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.711475 Apr 18 16:26:44 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 148/438] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 16:26:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 16:26:44 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-b4659746-b675-44d1-801a-035a437c53eb tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:26:44 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-b4659746-b675-44d1-801a-035a437c53eb tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 2e71dfcf-8ffe-47de-9922-ad5a01615168] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:26:44 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:26:44 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-b4659746-b675-44d1-801a-035a437c53eb tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add4c9d906ba49a590f203e0aa98ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4b993c13b46ea8f80b0caed60a373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:26:44 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-b4659746-b675-44d1-801a-035a437c53eb tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e71dfcf-8ffe-47de-9922-ad5a01615168" status: 200 len: 1252 microversion: 2.1 time: 0.071776 Apr 18 16:26:44 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 144/439] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:26:44 2023] GET /compute/v2.1/servers/2e71dfcf-8ffe-47de-9922-ad5a01615168 => generated 1252 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:26:47 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-ee1e9453-7ae5-4c22-aef8-dd1e7b2e7b74 req-1d28bdbd-157d-4772-8e24-34bf76b33989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e71dfcf-8ffe-47de-9922-ad5a01615168", "tag": "a625f474-3393-4722-8b87-e0fcff38705b"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:26:47 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-ee1e9453-7ae5-4c22-aef8-dd1e7b2e7b74 req-1d28bdbd-157d-4772-8e24-34bf76b33989 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:47 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-ee1e9453-7ae5-4c22-aef8-dd1e7b2e7b74 req-1d28bdbd-157d-4772-8e24-34bf76b33989 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:47 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-ee1e9453-7ae5-4c22-aef8-dd1e7b2e7b74 req-1d28bdbd-157d-4772-8e24-34bf76b33989 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:47 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-ee1e9453-7ae5-4c22-aef8-dd1e7b2e7b74 req-1d28bdbd-157d-4772-8e24-34bf76b33989 service nova] Creating event network-changed:a625f474-3393-4722-8b87-e0fcff38705b for instance 2e71dfcf-8ffe-47de-9922-ad5a01615168 on user Apr 18 16:26:47 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-ee1e9453-7ae5-4c22-aef8-dd1e7b2e7b74 req-1d28bdbd-157d-4772-8e24-34bf76b33989 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029872 Apr 18 16:26:47 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 148/440] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:26:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:26:49 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-5e513f5d-94fd-42b6-8991-e12eafd42266 req-fb4991f8-2b03-4a2b-874d-e846c0f1f91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e71dfcf-8ffe-47de-9922-ad5a01615168", "name": "network-vif-plugged", "status": "completed", "tag": "a625f474-3393-4722-8b87-e0fcff38705b"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:26:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-5e513f5d-94fd-42b6-8991-e12eafd42266 req-fb4991f8-2b03-4a2b-874d-e846c0f1f91b service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-5e513f5d-94fd-42b6-8991-e12eafd42266 req-fb4991f8-2b03-4a2b-874d-e846c0f1f91b service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:49 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-5e513f5d-94fd-42b6-8991-e12eafd42266 req-fb4991f8-2b03-4a2b-874d-e846c0f1f91b service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:49 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-5e513f5d-94fd-42b6-8991-e12eafd42266 req-fb4991f8-2b03-4a2b-874d-e846c0f1f91b service nova] Creating event network-vif-plugged:a625f474-3393-4722-8b87-e0fcff38705b for instance 2e71dfcf-8ffe-47de-9922-ad5a01615168 on user Apr 18 16:26:49 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-5e513f5d-94fd-42b6-8991-e12eafd42266 req-fb4991f8-2b03-4a2b-874d-e846c0f1f91b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036070 Apr 18 16:26:49 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 149/441] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:26:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:26:51 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-a3489670-e4e0-4a42-93e3-9724e5b9e83b req-8478acd9-36a9-4bca-8555-eae42ddfbd37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e71dfcf-8ffe-47de-9922-ad5a01615168", "name": "network-vif-plugged", "status": "completed", "tag": "a625f474-3393-4722-8b87-e0fcff38705b"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:26:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-a3489670-e4e0-4a42-93e3-9724e5b9e83b req-8478acd9-36a9-4bca-8555-eae42ddfbd37 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:26:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-a3489670-e4e0-4a42-93e3-9724e5b9e83b req-8478acd9-36a9-4bca-8555-eae42ddfbd37 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:26:51 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-a3489670-e4e0-4a42-93e3-9724e5b9e83b req-8478acd9-36a9-4bca-8555-eae42ddfbd37 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:26:51 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-a3489670-e4e0-4a42-93e3-9724e5b9e83b req-8478acd9-36a9-4bca-8555-eae42ddfbd37 service nova] Creating event network-vif-plugged:a625f474-3393-4722-8b87-e0fcff38705b for instance 2e71dfcf-8ffe-47de-9922-ad5a01615168 on user Apr 18 16:26:51 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-a3489670-e4e0-4a42-93e3-9724e5b9e83b req-8478acd9-36a9-4bca-8555-eae42ddfbd37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029225 Apr 18 16:26:51 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 145/442] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:26:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:27:20 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell0:SELECT=4 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:27:20 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:27:20 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=2 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:27:20 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-91e92562-1acc-4d97-9044-9e56341d7400 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:27:20 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-91e92562-1acc-4d97-9044-9e56341d7400 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] [instance: 6528f05a-9f05-4f35-b991-687e4f47029e] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:27:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-91e92562-1acc-4d97-9044-9e56341d7400 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:27:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-91e92562-1acc-4d97-9044-9e56341d7400 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:27:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-91e92562-1acc-4d97-9044-9e56341d7400 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:27:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-91e92562-1acc-4d97-9044-9e56341d7400 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:27:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-91e92562-1acc-4d97-9044-9e56341d7400 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:27:20 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-91e92562-1acc-4d97-9044-9e56341d7400 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:27:20 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-91e92562-1acc-4d97-9044-9e56341d7400 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] HTTP exception thrown: Instance 6528f05a-9f05-4f35-b991-687e4f47029e could not be found. Apr 18 16:27:20 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-91e92562-1acc-4d97-9044-9e56341d7400 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Request method failure captured: Apr 18 16:27:20 user devstack@n-api.service[61294]: request: GET /compute/v2.1/servers/6528f05a-9f05-4f35-b991-687e4f47029e HTTP/1.1 Apr 18 16:27:20 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:27:20 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:27:20 user devstack@n-api.service[61294]: Connection: close Apr 18 16:27:20 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:27:20 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:27:20 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:27:20 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:27:20 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:27:20 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsK2urU6zpYqUryz6kjpRn_xfxcKxINV1Fl_rLQYN2scVWoJVqIsK36YQ3bNyjICQcU8HREYr_ExKMh5uXEcfyIW1BrC1Xqz8VwomDMYtvOQk2GnF-AFhsloFkL0DmGDBdhjNiuaxvPgTkmTGjm-Y9koAadk2AwhEGpApMZnjVLcVrY Apr 18 16:27:20 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:27:20 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:27:20 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:27:20 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:27:20 user devstack@n-api.service[61294]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 16:27:20 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:27:20 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:27:20 user devstack@n-api.service[61294]: X-Project-Id: f516f5ec45ca4508841c77f79e8c038b Apr 18 16:27:20 user devstack@n-api.service[61294]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2021464272 Apr 18 16:27:20 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:27:20 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:27:20 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f516f5ec45ca4508841c77f79e8c038b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f516f5ec45ca4508841c77f79e8c038b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f516f5ec45ca4508841c77f79e8c038b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:27:20 user devstack@n-api.service[61294]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2021464272 Apr 18 16:27:20 user devstack@n-api.service[61294]: X-Tenant-Id: f516f5ec45ca4508841c77f79e8c038b Apr 18 16:27:20 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2021464272 Apr 18 16:27:20 user devstack@n-api.service[61294]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member Apr 18 16:27:20 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:27:20 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:27:20 user devstack@n-api.service[61294]: X-User-Id: c54c277689214bd0a2cadb1e2ac288a9 Apr 18 16:27:20 user devstack@n-api.service[61294]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member Apr 18 16:27:20 user devstack@n-api.service[61294]: method: > Apr 18 16:27:20 user devstack@n-api.service[61294]: exception: Instance 6528f05a-9f05-4f35-b991-687e4f47029e could not be found. Apr 18 16:27:20 user devstack@n-api.service[61294]: action_args: {'id': '6528f05a-9f05-4f35-b991-687e4f47029e'} Apr 18 16:27:20 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6528f05a-9f05-4f35-b991-687e4f47029e could not be found. Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6528f05a-9f05-4f35-b991-687e4f47029e could not be found. Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6528f05a-9f05-4f35-b991-687e4f47029e could not be found. Apr 18 16:27:20 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:27:20 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-91e92562-1acc-4d97-9044-9e56341d7400 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] Returning 404 to user: Instance 6528f05a-9f05-4f35-b991-687e4f47029e could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:27:20 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-91e92562-1acc-4d97-9044-9e56341d7400 tempest-ServerBootFromVolumeStableRescueTest-2021464272 tempest-ServerBootFromVolumeStableRescueTest-2021464272-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6528f05a-9f05-4f35-b991-687e4f47029e" status: 404 len: 111 microversion: 2.87 time: 0.035616 Apr 18 16:27:20 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 149/443] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 16:27:20 2023] GET /compute/v2.1/servers/6528f05a-9f05-4f35-b991-687e4f47029e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 18 16:27:25 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:27:25 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=6 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:27:25 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:27:25 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=6 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:27:25 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-db666330-3ff3-4b39-80ec-4318085d73ba tempest-VolumesGetTestJSON-222508462 tempest-VolumesGetTestJSON-222508462-project-member] Action: 'create', calling method: .version_select at 0x7fd6c92cb130>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-888582694", "metadata": {"Type": "work"}}} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:27:25 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-db666330-3ff3-4b39-80ec-4318085d73ba tempest-VolumesGetTestJSON-222508462 tempest-VolumesGetTestJSON-222508462-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.495790 Apr 18 16:27:25 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 150/444] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 16:27:25 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 497 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 18 16:27:25 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-0dde53c0-e67f-4607-a40a-5c55304e214c tempest-VolumesGetTestJSON-222508462 tempest-VolumesGetTestJSON-222508462-project-member] Calling method '.version_select at 0x7fd6c92de950>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:27:25 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell0:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:27:25 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:27:25 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=2 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:27:25 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-0dde53c0-e67f-4607-a40a-5c55304e214c tempest-VolumesGetTestJSON-222508462 tempest-VolumesGetTestJSON-222508462-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8" status: 200 len: 349 microversion: 2.1 time: 0.098287 Apr 18 16:27:25 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 146/445] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 16:27:25 2023] GET /compute/v2.1/os-volumes/a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8 => generated 349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:27:26 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-3071f73a-2860-46c4-9ae6-45be4939bfc8 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:27:26 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-3071f73a-2860-46c4-9ae6-45be4939bfc8 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: 66df9389-d007-4737-8bb1-55bcb5f227ff] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:27:26 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-3071f73a-2860-46c4-9ae6-45be4939bfc8 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:27:26 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-3071f73a-2860-46c4-9ae6-45be4939bfc8 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:27:26 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-3071f73a-2860-46c4-9ae6-45be4939bfc8 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:27:26 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-3071f73a-2860-46c4-9ae6-45be4939bfc8 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:27:26 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-3071f73a-2860-46c4-9ae6-45be4939bfc8 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:27:26 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-3071f73a-2860-46c4-9ae6-45be4939bfc8 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:27:26 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-3071f73a-2860-46c4-9ae6-45be4939bfc8 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2963911de4f34d79816a9a1f9ad24a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5695adbb14ea4162bc40547b1509a1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:27:26 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-3071f73a-2860-46c4-9ae6-45be4939bfc8 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff" status: 200 len: 1495 microversion: 2.1 time: 0.234996 Apr 18 16:27:26 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 150/446] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:27:26 2023] GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff => generated 1495 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:27:26 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-7c756206-7ecd-4da3-b135-d2cbee52b278 tempest-VolumesGetTestJSON-222508462 tempest-VolumesGetTestJSON-222508462-project-member] Calling method '.version_select at 0x7fd6c912c670>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:27:26 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-7c756206-7ecd-4da3-b135-d2cbee52b278 tempest-VolumesGetTestJSON-222508462 tempest-VolumesGetTestJSON-222508462-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8" status: 200 len: 349 microversion: 2.1 time: 0.053625 Apr 18 16:27:26 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 151/447] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 16:27:26 2023] GET /compute/v2.1/os-volumes/a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8 => generated 349 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:27:26 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-671e01ad-9e43-4262-869c-8e3c708516bd tempest-VolumesGetTestJSON-222508462 tempest-VolumesGetTestJSON-222508462-project-member] Calling method '.version_select at 0x7fd6c92df010>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:27:26 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-671e01ad-9e43-4262-869c-8e3c708516bd tempest-VolumesGetTestJSON-222508462 tempest-VolumesGetTestJSON-222508462-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8" status: 202 len: 0 microversion: 2.1 time: 0.108983 Apr 18 16:27:26 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 147/448] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 16:27:26 2023] DELETE /compute/v2.1/os-volumes/a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:27:26 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-649b9214-a714-412a-abc5-e495390223e7 tempest-VolumesGetTestJSON-222508462 tempest-VolumesGetTestJSON-222508462-project-member] Calling method '.version_select at 0x7fd6c94e2830>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:27:26 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-649b9214-a714-412a-abc5-e495390223e7 tempest-VolumesGetTestJSON-222508462 tempest-VolumesGetTestJSON-222508462-project-member] HTTP exception thrown: Volume a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8 could not be found. Apr 18 16:27:26 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-649b9214-a714-412a-abc5-e495390223e7 tempest-VolumesGetTestJSON-222508462 tempest-VolumesGetTestJSON-222508462-project-member] Request method failure captured: Apr 18 16:27:26 user devstack@n-api.service[61294]: request: GET /compute/v2.1/os-volumes/a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8 HTTP/1.1 Apr 18 16:27:26 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:27:26 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:27:26 user devstack@n-api.service[61294]: Connection: close Apr 18 16:27:26 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:27:26 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:27:26 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:27:26 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:27:26 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:27:26 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsTsZ_Cal-cmpE3l6Mnkb1YBtidHA_hB5MOMLopTg2W0ilg1yXg-9WTCpRlc_FwBev1y-uOQbUHUZu43I3ST3lgAdrCkp6i7jjhq0Wszrc_jlP1fB4tz2Sx0mZC6dPjyZO20Va2_UptnmKavH2Bu3X0PT7ZmUe1yNQqR1-afVYcTVKs Apr 18 16:27:26 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:27:26 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:27:26 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:27:26 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:27:26 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:27:26 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:27:26 user devstack@n-api.service[61294]: X-Project-Id: fc44f5e5bd9f4749beac8b85ef9fdbb0 Apr 18 16:27:26 user devstack@n-api.service[61294]: X-Project-Name: tempest-VolumesGetTestJSON-222508462 Apr 18 16:27:26 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:27:26 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:27:26 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fc44f5e5bd9f4749beac8b85ef9fdbb0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fc44f5e5bd9f4749beac8b85ef9fdbb0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fc44f5e5bd9f4749beac8b85ef9fdbb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:27:26 user devstack@n-api.service[61294]: X-Tenant: tempest-VolumesGetTestJSON-222508462 Apr 18 16:27:26 user devstack@n-api.service[61294]: X-Tenant-Id: fc44f5e5bd9f4749beac8b85ef9fdbb0 Apr 18 16:27:26 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-VolumesGetTestJSON-222508462 Apr 18 16:27:26 user devstack@n-api.service[61294]: X-User: tempest-VolumesGetTestJSON-222508462-project-member Apr 18 16:27:26 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:27:26 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:27:26 user devstack@n-api.service[61294]: X-User-Id: c4c3dbe518e3419c9fc186bd849c0943 Apr 18 16:27:26 user devstack@n-api.service[61294]: X-User-Name: tempest-VolumesGetTestJSON-222508462-project-member Apr 18 16:27:26 user devstack@n-api.service[61294]: method: Apr 18 16:27:26 user devstack@n-api.service[61294]: exception: Volume a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8 could not be found. Apr 18 16:27:26 user devstack@n-api.service[61294]: action_args: {'id': 'a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8'} Apr 18 16:27:26 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8 could not be found. (HTTP 404) (Request-ID: req-30569a0e-c926-48d8-a612-1ba290af6758) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8 could not be found. Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8 could not be found. Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8 could not be found. Apr 18 16:27:26 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:27:26 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-649b9214-a714-412a-abc5-e495390223e7 tempest-VolumesGetTestJSON-222508462 tempest-VolumesGetTestJSON-222508462-project-member] Returning 404 to user: Volume a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8 could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:27:26 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-649b9214-a714-412a-abc5-e495390223e7 tempest-VolumesGetTestJSON-222508462 tempest-VolumesGetTestJSON-222508462-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8" status: 404 len: 109 microversion: 2.1 time: 0.082624 Apr 18 16:27:26 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 151/449] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 16:27:26 2023] GET /compute/v2.1/os-volumes/a67e2b91-5ea6-4dc9-b380-f30d88f7f5c8 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:27:34 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-4b1cb506-ca8f-4fca-ab3d-a93b48f44a1f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:27:34 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-4b1cb506-ca8f-4fca-ab3d-a93b48f44a1f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 2e71dfcf-8ffe-47de-9922-ad5a01615168] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:27:34 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4b1cb506-ca8f-4fca-ab3d-a93b48f44a1f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:27:34 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4b1cb506-ca8f-4fca-ab3d-a93b48f44a1f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:27:34 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4b1cb506-ca8f-4fca-ab3d-a93b48f44a1f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:27:34 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4b1cb506-ca8f-4fca-ab3d-a93b48f44a1f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:27:34 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4b1cb506-ca8f-4fca-ab3d-a93b48f44a1f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:27:34 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-4b1cb506-ca8f-4fca-ab3d-a93b48f44a1f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:27:34 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-4b1cb506-ca8f-4fca-ab3d-a93b48f44a1f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add4c9d906ba49a590f203e0aa98ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4b993c13b46ea8f80b0caed60a373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:27:34 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-4b1cb506-ca8f-4fca-ab3d-a93b48f44a1f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e71dfcf-8ffe-47de-9922-ad5a01615168" status: 200 len: 1536 microversion: 2.1 time: 0.238040 Apr 18 16:27:34 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 152/450] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:27:34 2023] GET /compute/v2.1/servers/2e71dfcf-8ffe-47de-9922-ad5a01615168 => generated 1536 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:28:27 user devstack@n-api.service[61296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 16:28:27 user devstack@n-api.service[61296]: Tue Apr 18 16:28:27 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff (ip 10.0.0.210) !!! Apr 18 16:28:27 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-dc90f7b5-9249-409f-b853-bc1a308ea495 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:28:27 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-dc90f7b5-9249-409f-b853-bc1a308ea495 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: 66df9389-d007-4737-8bb1-55bcb5f227ff] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:28:27 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-dc90f7b5-9249-409f-b853-bc1a308ea495 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:28:27 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-dc90f7b5-9249-409f-b853-bc1a308ea495 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:28:27 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-dc90f7b5-9249-409f-b853-bc1a308ea495 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:28:27 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-dc90f7b5-9249-409f-b853-bc1a308ea495 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:28:27 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-dc90f7b5-9249-409f-b853-bc1a308ea495 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:28:27 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-dc90f7b5-9249-409f-b853-bc1a308ea495 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:28:27 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-dc90f7b5-9249-409f-b853-bc1a308ea495 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2963911de4f34d79816a9a1f9ad24a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5695adbb14ea4162bc40547b1509a1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:28:27 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-dc90f7b5-9249-409f-b853-bc1a308ea495 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff" status: 200 len: 1495 microversion: 2.1 time: 0.269689 Apr 18 16:28:27 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 148/451] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:28:27 2023] GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff => generated 1495 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:28:34 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=4 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:28:34 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=8 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:28:34 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-f45a1f71-2c22-4d79-8d1b-720156b43768 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:28:34 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-f45a1f71-2c22-4d79-8d1b-720156b43768 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 2e71dfcf-8ffe-47de-9922-ad5a01615168] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:28:34 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-f45a1f71-2c22-4d79-8d1b-720156b43768 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:28:34 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-f45a1f71-2c22-4d79-8d1b-720156b43768 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:28:34 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-f45a1f71-2c22-4d79-8d1b-720156b43768 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:28:34 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-f45a1f71-2c22-4d79-8d1b-720156b43768 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:28:34 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-f45a1f71-2c22-4d79-8d1b-720156b43768 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:28:34 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-f45a1f71-2c22-4d79-8d1b-720156b43768 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:28:34 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-f45a1f71-2c22-4d79-8d1b-720156b43768 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add4c9d906ba49a590f203e0aa98ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4b993c13b46ea8f80b0caed60a373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:28:35 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-f45a1f71-2c22-4d79-8d1b-720156b43768 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e71dfcf-8ffe-47de-9922-ad5a01615168" status: 200 len: 1536 microversion: 2.1 time: 0.240809 Apr 18 16:28:35 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 152/452] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:28:34 2023] GET /compute/v2.1/servers/2e71dfcf-8ffe-47de-9922-ad5a01615168 => generated 1536 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:28:35 user devstack@n-api.service[61295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 16:28:35 user devstack@n-api.service[61295]: Tue Apr 18 16:28:35 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 18 16:28:35 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:28:35 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=6 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:28:35 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-85be58da-019d-4440-94a2-c565ab0a4c8a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:28:35 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-85be58da-019d-4440-94a2-c565ab0a4c8a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'add4c9d906ba49a590f203e0aa98ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4b993c13b46ea8f80b0caed60a373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:28:35 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-85be58da-019d-4440-94a2-c565ab0a4c8a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Searching by: {'deleted': False, 'project_id': '00d4b993c13b46ea8f80b0caed60a373'} {{(pid=61295) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 18 16:28:35 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-85be58da-019d-4440-94a2-c565ab0a4c8a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:28:35 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-85be58da-019d-4440-94a2-c565ab0a4c8a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:28:35 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-85be58da-019d-4440-94a2-c565ab0a4c8a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:28:35 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-85be58da-019d-4440-94a2-c565ab0a4c8a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:28:35 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-85be58da-019d-4440-94a2-c565ab0a4c8a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:28:35 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-85be58da-019d-4440-94a2-c565ab0a4c8a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:28:35 user devstack@n-api.service[61295]: DEBUG nova.compute.multi_cell_list [None req-85be58da-019d-4440-94a2-c565ab0a4c8a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61295) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 18 16:28:35 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-85be58da-019d-4440-94a2-c565ab0a4c8a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.207406 Apr 18 16:28:35 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 153/453] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 18 16:28:35 2023] GET /compute/v2.1/servers => generated 340 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:28:35 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-087834b7-19d4-4eab-b682-4e3058d89ff8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:28:35 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-087834b7-19d4-4eab-b682-4e3058d89ff8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 2e71dfcf-8ffe-47de-9922-ad5a01615168] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:28:35 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-087834b7-19d4-4eab-b682-4e3058d89ff8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:28:35 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-087834b7-19d4-4eab-b682-4e3058d89ff8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:28:35 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-087834b7-19d4-4eab-b682-4e3058d89ff8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:28:35 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-087834b7-19d4-4eab-b682-4e3058d89ff8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:28:35 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-087834b7-19d4-4eab-b682-4e3058d89ff8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:28:35 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-087834b7-19d4-4eab-b682-4e3058d89ff8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:28:35 user devstack@n-api.service[61296]: DEBUG nova.policy [None req-087834b7-19d4-4eab-b682-4e3058d89ff8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add4c9d906ba49a590f203e0aa98ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4b993c13b46ea8f80b0caed60a373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61296) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:28:35 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-087834b7-19d4-4eab-b682-4e3058d89ff8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e71dfcf-8ffe-47de-9922-ad5a01615168" status: 200 len: 1536 microversion: 2.1 time: 0.228348 Apr 18 16:28:35 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 149/454] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:28:35 2023] GET /compute/v2.1/servers/2e71dfcf-8ffe-47de-9922-ad5a01615168 => generated 1536 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:28:37 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-24a91138-43db-42d8-b1c1-df81fa3b53da tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:28:37 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-24a91138-43db-42d8-b1c1-df81fa3b53da tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 2e71dfcf-8ffe-47de-9922-ad5a01615168] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:28:37 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-24a91138-43db-42d8-b1c1-df81fa3b53da tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:28:37 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-24a91138-43db-42d8-b1c1-df81fa3b53da tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:28:37 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-24a91138-43db-42d8-b1c1-df81fa3b53da tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:28:37 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-24a91138-43db-42d8-b1c1-df81fa3b53da tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:28:37 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-24a91138-43db-42d8-b1c1-df81fa3b53da tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:28:37 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-24a91138-43db-42d8-b1c1-df81fa3b53da tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:28:37 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-24a91138-43db-42d8-b1c1-df81fa3b53da tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 2e71dfcf-8ffe-47de-9922-ad5a01615168] Going to try to terminate instance {{(pid=61294) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:28:37 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-24a91138-43db-42d8-b1c1-df81fa3b53da tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2e71dfcf-8ffe-47de-9922-ad5a01615168" status: 204 len: 0 microversion: 2.1 time: 0.114108 Apr 18 16:28:37 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 153/455] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:28:37 2023] DELETE /compute/v2.1/servers/2e71dfcf-8ffe-47de-9922-ad5a01615168 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:28:37 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-0f5d2031-7484-492e-8825-a00d018af2b8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:28:37 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-0f5d2031-7484-492e-8825-a00d018af2b8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 2e71dfcf-8ffe-47de-9922-ad5a01615168] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:28:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0f5d2031-7484-492e-8825-a00d018af2b8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:28:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0f5d2031-7484-492e-8825-a00d018af2b8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:28:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0f5d2031-7484-492e-8825-a00d018af2b8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:28:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0f5d2031-7484-492e-8825-a00d018af2b8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:28:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0f5d2031-7484-492e-8825-a00d018af2b8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:28:37 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-0f5d2031-7484-492e-8825-a00d018af2b8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:28:37 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-31c0c009-fe2e-4f20-927b-11eb83fed2e9 req-7c14e14d-0abd-41fe-9dcd-f66c2e354231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e71dfcf-8ffe-47de-9922-ad5a01615168", "name": "network-vif-unplugged", "status": "completed", "tag": "a625f474-3393-4722-8b87-e0fcff38705b"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:28:37 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-31c0c009-fe2e-4f20-927b-11eb83fed2e9 req-7c14e14d-0abd-41fe-9dcd-f66c2e354231 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:28:37 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-31c0c009-fe2e-4f20-927b-11eb83fed2e9 req-7c14e14d-0abd-41fe-9dcd-f66c2e354231 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:28:37 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-31c0c009-fe2e-4f20-927b-11eb83fed2e9 req-7c14e14d-0abd-41fe-9dcd-f66c2e354231 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:28:37 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-31c0c009-fe2e-4f20-927b-11eb83fed2e9 req-7c14e14d-0abd-41fe-9dcd-f66c2e354231 service nova] Creating event network-vif-unplugged:a625f474-3393-4722-8b87-e0fcff38705b for instance 2e71dfcf-8ffe-47de-9922-ad5a01615168 on user Apr 18 16:28:37 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-31c0c009-fe2e-4f20-927b-11eb83fed2e9 req-7c14e14d-0abd-41fe-9dcd-f66c2e354231 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032953 Apr 18 16:28:37 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 150/456] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:28:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:28:37 user devstack@n-api.service[61295]: DEBUG nova.policy [None req-0f5d2031-7484-492e-8825-a00d018af2b8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add4c9d906ba49a590f203e0aa98ab64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d4b993c13b46ea8f80b0caed60a373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61295) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:28:37 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-0f5d2031-7484-492e-8825-a00d018af2b8 tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e71dfcf-8ffe-47de-9922-ad5a01615168" status: 200 len: 1542 microversion: 2.1 time: 0.369897 Apr 18 16:28:37 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 154/457] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:28:37 2023] GET /compute/v2.1/servers/2e71dfcf-8ffe-47de-9922-ad5a01615168 => generated 1542 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:28:39 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [req-744b2252-a505-4305-a533-8f9eefc512e9 req-804d3808-2210-46a4-bcc8-0265b4e938c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e71dfcf-8ffe-47de-9922-ad5a01615168", "name": "network-vif-plugged", "status": "completed", "tag": "a625f474-3393-4722-8b87-e0fcff38705b"}, {"server_uuid": "2e71dfcf-8ffe-47de-9922-ad5a01615168", "name": "network-vif-plugged", "status": "completed", "tag": "a625f474-3393-4722-8b87-e0fcff38705b"}, {"server_uuid": "2e71dfcf-8ffe-47de-9922-ad5a01615168", "name": "network-vif-plugged", "status": "completed", "tag": "a625f474-3393-4722-8b87-e0fcff38705b"}, {"server_uuid": "2e71dfcf-8ffe-47de-9922-ad5a01615168", "name": "network-vif-plugged", "status": "completed", "tag": "a625f474-3393-4722-8b87-e0fcff38705b"}, {"server_uuid": "2e71dfcf-8ffe-47de-9922-ad5a01615168", "name": "network-vif-deleted", "tag": "a625f474-3393-4722-8b87-e0fcff38705b"}]} {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:28:39 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-744b2252-a505-4305-a533-8f9eefc512e9 req-804d3808-2210-46a4-bcc8-0265b4e938c6 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:28:39 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-744b2252-a505-4305-a533-8f9eefc512e9 req-804d3808-2210-46a4-bcc8-0265b4e938c6 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:28:39 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [req-744b2252-a505-4305-a533-8f9eefc512e9 req-804d3808-2210-46a4-bcc8-0265b4e938c6 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:28:39 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-744b2252-a505-4305-a533-8f9eefc512e9 req-804d3808-2210-46a4-bcc8-0265b4e938c6 service nova] Creating event network-vif-plugged:a625f474-3393-4722-8b87-e0fcff38705b for instance 2e71dfcf-8ffe-47de-9922-ad5a01615168 on user Apr 18 16:28:39 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-744b2252-a505-4305-a533-8f9eefc512e9 req-804d3808-2210-46a4-bcc8-0265b4e938c6 service nova] Creating event network-vif-plugged:a625f474-3393-4722-8b87-e0fcff38705b for instance 2e71dfcf-8ffe-47de-9922-ad5a01615168 on user Apr 18 16:28:39 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-744b2252-a505-4305-a533-8f9eefc512e9 req-804d3808-2210-46a4-bcc8-0265b4e938c6 service nova] Creating event network-vif-plugged:a625f474-3393-4722-8b87-e0fcff38705b for instance 2e71dfcf-8ffe-47de-9922-ad5a01615168 on user Apr 18 16:28:39 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-744b2252-a505-4305-a533-8f9eefc512e9 req-804d3808-2210-46a4-bcc8-0265b4e938c6 service nova] Creating event network-vif-plugged:a625f474-3393-4722-8b87-e0fcff38705b for instance 2e71dfcf-8ffe-47de-9922-ad5a01615168 on user Apr 18 16:28:39 user devstack@n-api.service[61294]: INFO nova.api.openstack.compute.server_external_events [req-744b2252-a505-4305-a533-8f9eefc512e9 req-804d3808-2210-46a4-bcc8-0265b4e938c6 service nova] Creating event network-vif-deleted:a625f474-3393-4722-8b87-e0fcff38705b for instance 2e71dfcf-8ffe-47de-9922-ad5a01615168 on user Apr 18 16:28:39 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [req-744b2252-a505-4305-a533-8f9eefc512e9 req-804d3808-2210-46a4-bcc8-0265b4e938c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.041374 Apr 18 16:28:39 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 154/458] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:28:39 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:29:27 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_api:SELECT=6 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:29:27 user devstack@n-api.service[61296]: DEBUG dbcounter [-] [61296] Writing DB stats nova_cell1:SELECT=14 {{(pid=61296) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:29:27 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-aaa37f80-41cc-4fb5-9fc5-557537e0e22a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:29:27 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-aaa37f80-41cc-4fb5-9fc5-557537e0e22a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] [instance: 2e71dfcf-8ffe-47de-9922-ad5a01615168] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:29:27 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-aaa37f80-41cc-4fb5-9fc5-557537e0e22a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:29:27 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-aaa37f80-41cc-4fb5-9fc5-557537e0e22a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:29:27 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-aaa37f80-41cc-4fb5-9fc5-557537e0e22a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:29:27 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-aaa37f80-41cc-4fb5-9fc5-557537e0e22a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:29:27 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-aaa37f80-41cc-4fb5-9fc5-557537e0e22a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:29:27 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-aaa37f80-41cc-4fb5-9fc5-557537e0e22a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:29:27 user devstack@n-api.service[61296]: INFO nova.api.openstack.wsgi [None req-aaa37f80-41cc-4fb5-9fc5-557537e0e22a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] HTTP exception thrown: Instance 2e71dfcf-8ffe-47de-9922-ad5a01615168 could not be found. Apr 18 16:29:27 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-aaa37f80-41cc-4fb5-9fc5-557537e0e22a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Request method failure captured: Apr 18 16:29:27 user devstack@n-api.service[61296]: request: GET /compute/v2.1/servers/2e71dfcf-8ffe-47de-9922-ad5a01615168 HTTP/1.1 Apr 18 16:29:27 user devstack@n-api.service[61296]: Accept: application/json Apr 18 16:29:27 user devstack@n-api.service[61296]: Accept-Encoding: identity Apr 18 16:29:27 user devstack@n-api.service[61296]: Connection: close Apr 18 16:29:27 user devstack@n-api.service[61296]: Content-Length: 0 Apr 18 16:29:27 user devstack@n-api.service[61296]: Content-Type: application/json Apr 18 16:29:27 user devstack@n-api.service[61296]: Host: 10.0.0.210 Apr 18 16:29:27 user devstack@n-api.service[61296]: Openstack-System-Scope: None Apr 18 16:29:27 user devstack@n-api.service[61296]: User-Agent: python-urllib3/1.26.15 Apr 18 16:29:27 user devstack@n-api.service[61296]: X-Auth-Token: gAAAAABkPsQREe0C10OrZt7V2hmQPkE1ccpQJK6JY0xIGHNjPwGvkuAM93tO0c78v5YDrfR7eRDwXFSiC-feyB6TpfRIoYbwRDevmRstZb-6khUDRlO_16nNhU8JtVkPIZoGEUXzabIyXgmvf9qKYA6Ws56tnhbSwpUR_gLKrTO4K3Lr_zYYKzk Apr 18 16:29:27 user devstack@n-api.service[61296]: X-Domain-Id: None Apr 18 16:29:27 user devstack@n-api.service[61296]: X-Domain-Name: None Apr 18 16:29:27 user devstack@n-api.service[61296]: X-Identity-Status: Confirmed Apr 18 16:29:27 user devstack@n-api.service[61296]: X-Is-Admin-Project: True Apr 18 16:29:27 user devstack@n-api.service[61296]: X-Project-Domain-Id: default Apr 18 16:29:27 user devstack@n-api.service[61296]: X-Project-Domain-Name: Default Apr 18 16:29:27 user devstack@n-api.service[61296]: X-Project-Id: 00d4b993c13b46ea8f80b0caed60a373 Apr 18 16:29:27 user devstack@n-api.service[61296]: X-Project-Name: tempest-TestMinimumBasicScenario-386776323 Apr 18 16:29:27 user devstack@n-api.service[61296]: X-Role: reader,member Apr 18 16:29:27 user devstack@n-api.service[61296]: X-Roles: reader,member Apr 18 16:29:27 user devstack@n-api.service[61296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/00d4b993c13b46ea8f80b0caed60a373"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/00d4b993c13b46ea8f80b0caed60a373"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/00d4b993c13b46ea8f80b0caed60a373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:29:27 user devstack@n-api.service[61296]: X-Tenant: tempest-TestMinimumBasicScenario-386776323 Apr 18 16:29:27 user devstack@n-api.service[61296]: X-Tenant-Id: 00d4b993c13b46ea8f80b0caed60a373 Apr 18 16:29:27 user devstack@n-api.service[61296]: X-Tenant-Name: tempest-TestMinimumBasicScenario-386776323 Apr 18 16:29:27 user devstack@n-api.service[61296]: X-User: tempest-TestMinimumBasicScenario-386776323-project-member Apr 18 16:29:27 user devstack@n-api.service[61296]: X-User-Domain-Id: default Apr 18 16:29:27 user devstack@n-api.service[61296]: X-User-Domain-Name: Default Apr 18 16:29:27 user devstack@n-api.service[61296]: X-User-Id: add4c9d906ba49a590f203e0aa98ab64 Apr 18 16:29:27 user devstack@n-api.service[61296]: X-User-Name: tempest-TestMinimumBasicScenario-386776323-project-member Apr 18 16:29:27 user devstack@n-api.service[61296]: method: > Apr 18 16:29:27 user devstack@n-api.service[61296]: exception: Instance 2e71dfcf-8ffe-47de-9922-ad5a01615168 could not be found. Apr 18 16:29:27 user devstack@n-api.service[61296]: action_args: {'id': '2e71dfcf-8ffe-47de-9922-ad5a01615168'} Apr 18 16:29:27 user devstack@n-api.service[61296]: {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e71dfcf-8ffe-47de-9922-ad5a01615168 could not be found. Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e71dfcf-8ffe-47de-9922-ad5a01615168 could not be found. Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e71dfcf-8ffe-47de-9922-ad5a01615168 could not be found. Apr 18 16:29:27 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:29:27 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-aaa37f80-41cc-4fb5-9fc5-557537e0e22a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Returning 404 to user: Instance 2e71dfcf-8ffe-47de-9922-ad5a01615168 could not be found. {{(pid=61296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:29:27 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-aaa37f80-41cc-4fb5-9fc5-557537e0e22a tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e71dfcf-8ffe-47de-9922-ad5a01615168" status: 404 len: 111 microversion: 2.1 time: 0.259032 Apr 18 16:29:27 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 151/459] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:29:27 2023] GET /compute/v2.1/servers/2e71dfcf-8ffe-47de-9922-ad5a01615168 => generated 111 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:29:27 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-379aa54f-92ff-4b5b-a8dd-8eef1d5c574f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] Calling method '.version_select at 0x7fd6c912d5a0>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:29:27 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell0:SELECT=2 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:29:27 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_api:SELECT=4 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:29:27 user devstack@n-api.service[61295]: DEBUG dbcounter [-] [61295] Writing DB stats nova_cell1:SELECT=14 {{(pid=61295) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:29:27 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-379aa54f-92ff-4b5b-a8dd-8eef1d5c574f tempest-TestMinimumBasicScenario-386776323 tempest-TestMinimumBasicScenario-386776323-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1240941080" status: 202 len: 0 microversion: 2.1 time: 0.031000 Apr 18 16:29:27 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 155/460] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 18 16:29:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1240941080 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-0a2de6e2-0ade-4e4c-9454-cb0b42b93934 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-0a2de6e2-0ade-4e4c-9454-cb0b42b93934 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: a4febff2-74e8-47ef-820d-f407a4d22d9d] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0a2de6e2-0ade-4e4c-9454-cb0b42b93934 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0a2de6e2-0ade-4e4c-9454-cb0b42b93934 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0a2de6e2-0ade-4e4c-9454-cb0b42b93934 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0a2de6e2-0ade-4e4c-9454-cb0b42b93934 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0a2de6e2-0ade-4e4c-9454-cb0b42b93934 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0a2de6e2-0ade-4e4c-9454-cb0b42b93934 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:29:28 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-0a2de6e2-0ade-4e4c-9454-cb0b42b93934 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] HTTP exception thrown: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-0a2de6e2-0ade-4e4c-9454-cb0b42b93934 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Request method failure captured: Apr 18 16:29:28 user devstack@n-api.service[61294]: request: DELETE /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d HTTP/1.1 Apr 18 16:29:28 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:29:28 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:29:28 user devstack@n-api.service[61294]: Connection: close Apr 18 16:29:28 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:29:28 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:29:28 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:29:28 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:29:28 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:29:28 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsNidtOiGLu9U3NCLnT1tVML4gMuuQHVkB4nmR2sX9o1kAxzT-cfYGjSwNLbZzkESy4kLqtoL1_yM09EZ-hGt6lD3Wgj0_N0cdpmkN9k1S7PRmQLvTBoqaqmW19alkSk8QylYcw20lQ2NLkcj2z87bE6YpEid1_5-_YhM-3a7GScz14 Apr 18 16:29:28 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:29:28 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:29:28 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:29:28 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:29:28 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:29:28 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:29:28 user devstack@n-api.service[61294]: X-Project-Id: 5695adbb14ea4162bc40547b1509a1e4 Apr 18 16:29:28 user devstack@n-api.service[61294]: X-Project-Name: tempest-ServersNegativeTestJSON-1696086909 Apr 18 16:29:28 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:29:28 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:29:28 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5695adbb14ea4162bc40547b1509a1e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5695adbb14ea4162bc40547b1509a1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5695adbb14ea4162bc40547b1509a1e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:29:28 user devstack@n-api.service[61294]: X-Tenant: tempest-ServersNegativeTestJSON-1696086909 Apr 18 16:29:28 user devstack@n-api.service[61294]: X-Tenant-Id: 5695adbb14ea4162bc40547b1509a1e4 Apr 18 16:29:28 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1696086909 Apr 18 16:29:28 user devstack@n-api.service[61294]: X-User: tempest-ServersNegativeTestJSON-1696086909-project-member Apr 18 16:29:28 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:29:28 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:29:28 user devstack@n-api.service[61294]: X-User-Id: 2963911de4f34d79816a9a1f9ad24a27 Apr 18 16:29:28 user devstack@n-api.service[61294]: X-User-Name: tempest-ServersNegativeTestJSON-1696086909-project-member Apr 18 16:29:28 user devstack@n-api.service[61294]: method: > Apr 18 16:29:28 user devstack@n-api.service[61294]: exception: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. Apr 18 16:29:28 user devstack@n-api.service[61294]: action_args: {'id': 'a4febff2-74e8-47ef-820d-f407a4d22d9d'} Apr 18 16:29:28 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. Apr 18 16:29:28 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-0a2de6e2-0ade-4e4c-9454-cb0b42b93934 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Returning 404 to user: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:29:28 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-0a2de6e2-0ade-4e4c-9454-cb0b42b93934 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d" status: 404 len: 111 microversion: 2.1 time: 0.044867 Apr 18 16:29:28 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 155/461] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:29:28 2023] DELETE /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:29:28 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-34fff51e-2871-4fe9-bdce-2dd66d1f5958 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Calling method '>' {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:29:28 user devstack@n-api.service[61296]: DEBUG nova.compute.api [None req-34fff51e-2871-4fe9-bdce-2dd66d1f5958 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: a4febff2-74e8-47ef-820d-f407a4d22d9d] Fetching instance by UUID {{(pid=61296) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:29:28 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-34fff51e-2871-4fe9-bdce-2dd66d1f5958 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:29:28 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-34fff51e-2871-4fe9-bdce-2dd66d1f5958 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:29:28 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-34fff51e-2871-4fe9-bdce-2dd66d1f5958 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:29:28 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-34fff51e-2871-4fe9-bdce-2dd66d1f5958 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:29:28 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-34fff51e-2871-4fe9-bdce-2dd66d1f5958 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:29:28 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [None req-34fff51e-2871-4fe9-bdce-2dd66d1f5958 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:29:28 user devstack@n-api.service[61296]: INFO nova.api.openstack.wsgi [None req-34fff51e-2871-4fe9-bdce-2dd66d1f5958 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] HTTP exception thrown: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. Apr 18 16:29:28 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-34fff51e-2871-4fe9-bdce-2dd66d1f5958 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Request method failure captured: Apr 18 16:29:28 user devstack@n-api.service[61296]: request: GET /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d HTTP/1.1 Apr 18 16:29:28 user devstack@n-api.service[61296]: Accept: application/json Apr 18 16:29:28 user devstack@n-api.service[61296]: Accept-Encoding: identity Apr 18 16:29:28 user devstack@n-api.service[61296]: Connection: close Apr 18 16:29:28 user devstack@n-api.service[61296]: Content-Length: 0 Apr 18 16:29:28 user devstack@n-api.service[61296]: Content-Type: application/json Apr 18 16:29:28 user devstack@n-api.service[61296]: Host: 10.0.0.210 Apr 18 16:29:28 user devstack@n-api.service[61296]: Openstack-System-Scope: None Apr 18 16:29:28 user devstack@n-api.service[61296]: User-Agent: python-urllib3/1.26.15 Apr 18 16:29:28 user devstack@n-api.service[61296]: X-Auth-Token: gAAAAABkPsNidtOiGLu9U3NCLnT1tVML4gMuuQHVkB4nmR2sX9o1kAxzT-cfYGjSwNLbZzkESy4kLqtoL1_yM09EZ-hGt6lD3Wgj0_N0cdpmkN9k1S7PRmQLvTBoqaqmW19alkSk8QylYcw20lQ2NLkcj2z87bE6YpEid1_5-_YhM-3a7GScz14 Apr 18 16:29:28 user devstack@n-api.service[61296]: X-Domain-Id: None Apr 18 16:29:28 user devstack@n-api.service[61296]: X-Domain-Name: None Apr 18 16:29:28 user devstack@n-api.service[61296]: X-Identity-Status: Confirmed Apr 18 16:29:28 user devstack@n-api.service[61296]: X-Is-Admin-Project: True Apr 18 16:29:28 user devstack@n-api.service[61296]: X-Project-Domain-Id: default Apr 18 16:29:28 user devstack@n-api.service[61296]: X-Project-Domain-Name: Default Apr 18 16:29:28 user devstack@n-api.service[61296]: X-Project-Id: 5695adbb14ea4162bc40547b1509a1e4 Apr 18 16:29:28 user devstack@n-api.service[61296]: X-Project-Name: tempest-ServersNegativeTestJSON-1696086909 Apr 18 16:29:28 user devstack@n-api.service[61296]: X-Role: reader,member Apr 18 16:29:28 user devstack@n-api.service[61296]: X-Roles: reader,member Apr 18 16:29:28 user devstack@n-api.service[61296]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5695adbb14ea4162bc40547b1509a1e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5695adbb14ea4162bc40547b1509a1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5695adbb14ea4162bc40547b1509a1e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:29:28 user devstack@n-api.service[61296]: X-Tenant: tempest-ServersNegativeTestJSON-1696086909 Apr 18 16:29:28 user devstack@n-api.service[61296]: X-Tenant-Id: 5695adbb14ea4162bc40547b1509a1e4 Apr 18 16:29:28 user devstack@n-api.service[61296]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1696086909 Apr 18 16:29:28 user devstack@n-api.service[61296]: X-User: tempest-ServersNegativeTestJSON-1696086909-project-member Apr 18 16:29:28 user devstack@n-api.service[61296]: X-User-Domain-Id: default Apr 18 16:29:28 user devstack@n-api.service[61296]: X-User-Domain-Name: Default Apr 18 16:29:28 user devstack@n-api.service[61296]: X-User-Id: 2963911de4f34d79816a9a1f9ad24a27 Apr 18 16:29:28 user devstack@n-api.service[61296]: X-User-Name: tempest-ServersNegativeTestJSON-1696086909-project-member Apr 18 16:29:28 user devstack@n-api.service[61296]: method: > Apr 18 16:29:28 user devstack@n-api.service[61296]: exception: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. Apr 18 16:29:28 user devstack@n-api.service[61296]: action_args: {'id': 'a4febff2-74e8-47ef-820d-f407a4d22d9d'} Apr 18 16:29:28 user devstack@n-api.service[61296]: {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. Apr 18 16:29:28 user devstack@n-api.service[61296]: ERROR nova.api.openstack.wsgi Apr 18 16:29:28 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [None req-34fff51e-2871-4fe9-bdce-2dd66d1f5958 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Returning 404 to user: Instance a4febff2-74e8-47ef-820d-f407a4d22d9d could not be found. {{(pid=61296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:29:28 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [None req-34fff51e-2871-4fe9-bdce-2dd66d1f5958 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d" status: 404 len: 111 microversion: 2.1 time: 0.031104 Apr 18 16:29:28 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 152/462] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:29:28 2023] GET /compute/v2.1/servers/a4febff2-74e8-47ef-820d-f407a4d22d9d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 16:29:28 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [None req-8cb584c0-612d-4cc9-afed-5504d220544e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Calling method '>' {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:29:28 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-8cb584c0-612d-4cc9-afed-5504d220544e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: 66df9389-d007-4737-8bb1-55bcb5f227ff] Fetching instance by UUID {{(pid=61295) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:29:28 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8cb584c0-612d-4cc9-afed-5504d220544e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:29:28 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8cb584c0-612d-4cc9-afed-5504d220544e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:29:28 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8cb584c0-612d-4cc9-afed-5504d220544e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:29:28 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8cb584c0-612d-4cc9-afed-5504d220544e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:29:28 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8cb584c0-612d-4cc9-afed-5504d220544e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:29:28 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [None req-8cb584c0-612d-4cc9-afed-5504d220544e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:29:28 user devstack@n-api.service[61295]: DEBUG nova.compute.api [None req-8cb584c0-612d-4cc9-afed-5504d220544e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: 66df9389-d007-4737-8bb1-55bcb5f227ff] Going to try to terminate instance {{(pid=61295) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 16:29:28 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [None req-8cb584c0-612d-4cc9-afed-5504d220544e tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff" status: 204 len: 0 microversion: 2.1 time: 0.118139 Apr 18 16:29:28 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 156/463] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 16:29:28 2023] DELETE /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-c45fd7bf-d69a-4e96-8fc0-4946da273812 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-c45fd7bf-d69a-4e96-8fc0-4946da273812 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: 66df9389-d007-4737-8bb1-55bcb5f227ff] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c45fd7bf-d69a-4e96-8fc0-4946da273812 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c45fd7bf-d69a-4e96-8fc0-4946da273812 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c45fd7bf-d69a-4e96-8fc0-4946da273812 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c45fd7bf-d69a-4e96-8fc0-4946da273812 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c45fd7bf-d69a-4e96-8fc0-4946da273812 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-c45fd7bf-d69a-4e96-8fc0-4946da273812 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:29:28 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-b1799213-6b76-4bc7-9db4-611f1c3bca1e req-1d762318-6fbf-415c-bd80-21503652b189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66df9389-d007-4737-8bb1-55bcb5f227ff", "name": "network-vif-unplugged", "status": "completed", "tag": "b66d41ab-873c-4826-a3f8-d4f4276fff10"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:29:28 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-b1799213-6b76-4bc7-9db4-611f1c3bca1e req-1d762318-6fbf-415c-bd80-21503652b189 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:29:28 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-b1799213-6b76-4bc7-9db4-611f1c3bca1e req-1d762318-6fbf-415c-bd80-21503652b189 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:29:28 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-b1799213-6b76-4bc7-9db4-611f1c3bca1e req-1d762318-6fbf-415c-bd80-21503652b189 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:29:28 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-b1799213-6b76-4bc7-9db4-611f1c3bca1e req-1d762318-6fbf-415c-bd80-21503652b189 service nova] Creating event network-vif-unplugged:b66d41ab-873c-4826-a3f8-d4f4276fff10 for instance 66df9389-d007-4737-8bb1-55bcb5f227ff on user Apr 18 16:29:28 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-b1799213-6b76-4bc7-9db4-611f1c3bca1e req-1d762318-6fbf-415c-bd80-21503652b189 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033801 Apr 18 16:29:28 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 153/464] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:29:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:29:28 user devstack@n-api.service[61294]: DEBUG nova.policy [None req-c45fd7bf-d69a-4e96-8fc0-4946da273812 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2963911de4f34d79816a9a1f9ad24a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5695adbb14ea4162bc40547b1509a1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61294) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 16:29:28 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-c45fd7bf-d69a-4e96-8fc0-4946da273812 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff" status: 200 len: 1501 microversion: 2.1 time: 0.423307 Apr 18 16:29:28 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 156/465] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:29:28 2023] GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff => generated 1501 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 16:29:30 user devstack@n-api.service[61295]: DEBUG nova.api.openstack.wsgi [req-2c5fc940-2e4d-499f-9bc6-4fd82ba1c66d req-47649bdf-1f64-4f8c-8254-ecb51ad6dfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66df9389-d007-4737-8bb1-55bcb5f227ff", "name": "network-vif-deleted", "tag": "b66d41ab-873c-4826-a3f8-d4f4276fff10"}]} {{(pid=61295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:29:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-2c5fc940-2e4d-499f-9bc6-4fd82ba1c66d req-47649bdf-1f64-4f8c-8254-ecb51ad6dfe2 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:29:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-2c5fc940-2e4d-499f-9bc6-4fd82ba1c66d req-47649bdf-1f64-4f8c-8254-ecb51ad6dfe2 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:29:30 user devstack@n-api.service[61295]: DEBUG oslo_concurrency.lockutils [req-2c5fc940-2e4d-499f-9bc6-4fd82ba1c66d req-47649bdf-1f64-4f8c-8254-ecb51ad6dfe2 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61295) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:29:30 user devstack@n-api.service[61295]: INFO nova.api.openstack.compute.server_external_events [req-2c5fc940-2e4d-499f-9bc6-4fd82ba1c66d req-47649bdf-1f64-4f8c-8254-ecb51ad6dfe2 service nova] Creating event network-vif-deleted:b66d41ab-873c-4826-a3f8-d4f4276fff10 for instance 66df9389-d007-4737-8bb1-55bcb5f227ff on user Apr 18 16:29:30 user devstack@n-api.service[61295]: INFO nova.api.openstack.requestlog [req-2c5fc940-2e4d-499f-9bc6-4fd82ba1c66d req-47649bdf-1f64-4f8c-8254-ecb51ad6dfe2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027797 Apr 18 16:29:30 user devstack@n-api.service[61295]: [pid: 61295|app: 0|req: 157/466] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:29:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:29:30 user devstack@n-api.service[61296]: DEBUG nova.api.openstack.wsgi [req-e4b933e4-6ed7-4a41-b072-4c29546c668f req-d558802b-02aa-48b9-ac91-c603c6479734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66df9389-d007-4737-8bb1-55bcb5f227ff", "name": "network-vif-plugged", "status": "completed", "tag": "b66d41ab-873c-4826-a3f8-d4f4276fff10"}, {"server_uuid": "66df9389-d007-4737-8bb1-55bcb5f227ff", "name": "network-vif-plugged", "status": "completed", "tag": "b66d41ab-873c-4826-a3f8-d4f4276fff10"}, {"server_uuid": "66df9389-d007-4737-8bb1-55bcb5f227ff", "name": "network-vif-plugged", "status": "completed", "tag": "b66d41ab-873c-4826-a3f8-d4f4276fff10"}, {"server_uuid": "66df9389-d007-4737-8bb1-55bcb5f227ff", "name": "network-vif-unplugged", "status": "completed", "tag": "b66d41ab-873c-4826-a3f8-d4f4276fff10"}, {"server_uuid": "66df9389-d007-4737-8bb1-55bcb5f227ff", "name": "network-vif-plugged", "status": "completed", "tag": "b66d41ab-873c-4826-a3f8-d4f4276fff10"}]} {{(pid=61296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 16:29:30 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-e4b933e4-6ed7-4a41-b072-4c29546c668f req-d558802b-02aa-48b9-ac91-c603c6479734 service nova] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:29:30 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-e4b933e4-6ed7-4a41-b072-4c29546c668f req-d558802b-02aa-48b9-ac91-c603c6479734 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:29:30 user devstack@n-api.service[61296]: DEBUG oslo_concurrency.lockutils [req-e4b933e4-6ed7-4a41-b072-4c29546c668f req-d558802b-02aa-48b9-ac91-c603c6479734 service nova] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61296) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:29:30 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-e4b933e4-6ed7-4a41-b072-4c29546c668f req-d558802b-02aa-48b9-ac91-c603c6479734 service nova] Creating event network-vif-plugged:b66d41ab-873c-4826-a3f8-d4f4276fff10 for instance 66df9389-d007-4737-8bb1-55bcb5f227ff on user Apr 18 16:29:30 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-e4b933e4-6ed7-4a41-b072-4c29546c668f req-d558802b-02aa-48b9-ac91-c603c6479734 service nova] Creating event network-vif-plugged:b66d41ab-873c-4826-a3f8-d4f4276fff10 for instance 66df9389-d007-4737-8bb1-55bcb5f227ff on user Apr 18 16:29:30 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-e4b933e4-6ed7-4a41-b072-4c29546c668f req-d558802b-02aa-48b9-ac91-c603c6479734 service nova] Creating event network-vif-plugged:b66d41ab-873c-4826-a3f8-d4f4276fff10 for instance 66df9389-d007-4737-8bb1-55bcb5f227ff on user Apr 18 16:29:30 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-e4b933e4-6ed7-4a41-b072-4c29546c668f req-d558802b-02aa-48b9-ac91-c603c6479734 service nova] Creating event network-vif-unplugged:b66d41ab-873c-4826-a3f8-d4f4276fff10 for instance 66df9389-d007-4737-8bb1-55bcb5f227ff on user Apr 18 16:29:30 user devstack@n-api.service[61296]: INFO nova.api.openstack.compute.server_external_events [req-e4b933e4-6ed7-4a41-b072-4c29546c668f req-d558802b-02aa-48b9-ac91-c603c6479734 service nova] Creating event network-vif-plugged:b66d41ab-873c-4826-a3f8-d4f4276fff10 for instance 66df9389-d007-4737-8bb1-55bcb5f227ff on user Apr 18 16:29:30 user devstack@n-api.service[61296]: INFO nova.api.openstack.requestlog [req-e4b933e4-6ed7-4a41-b072-4c29546c668f req-d558802b-02aa-48b9-ac91-c603c6479734 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.033109 Apr 18 16:29:30 user devstack@n-api.service[61296]: [pid: 61296|app: 0|req: 154/467] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 16:29:30 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 16:30:18 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-0f4ff0d2-d644-40ff-9682-07a5d5736f89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Calling method '>' {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 16:30:18 user devstack@n-api.service[61294]: DEBUG nova.compute.api [None req-0f4ff0d2-d644-40ff-9682-07a5d5736f89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] [instance: 66df9389-d007-4737-8bb1-55bcb5f227ff] Fetching instance by UUID {{(pid=61294) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 16:30:18 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_api:SELECT=4 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:30:18 user devstack@n-api.service[61294]: DEBUG dbcounter [-] [61294] Writing DB stats nova_cell1:SELECT=8 {{(pid=61294) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 16:30:18 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0f4ff0d2-d644-40ff-9682-07a5d5736f89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:30:18 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0f4ff0d2-d644-40ff-9682-07a5d5736f89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:30:18 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0f4ff0d2-d644-40ff-9682-07a5d5736f89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:30:18 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0f4ff0d2-d644-40ff-9682-07a5d5736f89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Acquiring lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 16:30:18 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0f4ff0d2-d644-40ff-9682-07a5d5736f89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 16:30:18 user devstack@n-api.service[61294]: DEBUG oslo_concurrency.lockutils [None req-0f4ff0d2-d644-40ff-9682-07a5d5736f89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Lock "81a3690c-abe3-4bc7-91bb-28a6fe0b5bd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61294) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 16:30:18 user devstack@n-api.service[61294]: INFO nova.api.openstack.wsgi [None req-0f4ff0d2-d644-40ff-9682-07a5d5736f89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] HTTP exception thrown: Instance 66df9389-d007-4737-8bb1-55bcb5f227ff could not be found. Apr 18 16:30:18 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-0f4ff0d2-d644-40ff-9682-07a5d5736f89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Request method failure captured: Apr 18 16:30:18 user devstack@n-api.service[61294]: request: GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff HTTP/1.1 Apr 18 16:30:18 user devstack@n-api.service[61294]: Accept: application/json Apr 18 16:30:18 user devstack@n-api.service[61294]: Accept-Encoding: identity Apr 18 16:30:18 user devstack@n-api.service[61294]: Connection: close Apr 18 16:30:18 user devstack@n-api.service[61294]: Content-Length: 0 Apr 18 16:30:18 user devstack@n-api.service[61294]: Content-Type: application/json Apr 18 16:30:18 user devstack@n-api.service[61294]: Host: 10.0.0.210 Apr 18 16:30:18 user devstack@n-api.service[61294]: Openstack-System-Scope: None Apr 18 16:30:18 user devstack@n-api.service[61294]: User-Agent: python-urllib3/1.26.15 Apr 18 16:30:18 user devstack@n-api.service[61294]: X-Auth-Token: gAAAAABkPsNidtOiGLu9U3NCLnT1tVML4gMuuQHVkB4nmR2sX9o1kAxzT-cfYGjSwNLbZzkESy4kLqtoL1_yM09EZ-hGt6lD3Wgj0_N0cdpmkN9k1S7PRmQLvTBoqaqmW19alkSk8QylYcw20lQ2NLkcj2z87bE6YpEid1_5-_YhM-3a7GScz14 Apr 18 16:30:18 user devstack@n-api.service[61294]: X-Domain-Id: None Apr 18 16:30:18 user devstack@n-api.service[61294]: X-Domain-Name: None Apr 18 16:30:18 user devstack@n-api.service[61294]: X-Identity-Status: Confirmed Apr 18 16:30:18 user devstack@n-api.service[61294]: X-Is-Admin-Project: True Apr 18 16:30:18 user devstack@n-api.service[61294]: X-Project-Domain-Id: default Apr 18 16:30:18 user devstack@n-api.service[61294]: X-Project-Domain-Name: Default Apr 18 16:30:18 user devstack@n-api.service[61294]: X-Project-Id: 5695adbb14ea4162bc40547b1509a1e4 Apr 18 16:30:18 user devstack@n-api.service[61294]: X-Project-Name: tempest-ServersNegativeTestJSON-1696086909 Apr 18 16:30:18 user devstack@n-api.service[61294]: X-Role: reader,member Apr 18 16:30:18 user devstack@n-api.service[61294]: X-Roles: reader,member Apr 18 16:30:18 user devstack@n-api.service[61294]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5695adbb14ea4162bc40547b1509a1e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5695adbb14ea4162bc40547b1509a1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5695adbb14ea4162bc40547b1509a1e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 16:30:18 user devstack@n-api.service[61294]: X-Tenant: tempest-ServersNegativeTestJSON-1696086909 Apr 18 16:30:18 user devstack@n-api.service[61294]: X-Tenant-Id: 5695adbb14ea4162bc40547b1509a1e4 Apr 18 16:30:18 user devstack@n-api.service[61294]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1696086909 Apr 18 16:30:18 user devstack@n-api.service[61294]: X-User: tempest-ServersNegativeTestJSON-1696086909-project-member Apr 18 16:30:18 user devstack@n-api.service[61294]: X-User-Domain-Id: default Apr 18 16:30:18 user devstack@n-api.service[61294]: X-User-Domain-Name: Default Apr 18 16:30:18 user devstack@n-api.service[61294]: X-User-Id: 2963911de4f34d79816a9a1f9ad24a27 Apr 18 16:30:18 user devstack@n-api.service[61294]: X-User-Name: tempest-ServersNegativeTestJSON-1696086909-project-member Apr 18 16:30:18 user devstack@n-api.service[61294]: method: > Apr 18 16:30:18 user devstack@n-api.service[61294]: exception: Instance 66df9389-d007-4737-8bb1-55bcb5f227ff could not be found. Apr 18 16:30:18 user devstack@n-api.service[61294]: action_args: {'id': '66df9389-d007-4737-8bb1-55bcb5f227ff'} Apr 18 16:30:18 user devstack@n-api.service[61294]: {{(pid=61294) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66df9389-d007-4737-8bb1-55bcb5f227ff could not be found. Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66df9389-d007-4737-8bb1-55bcb5f227ff could not be found. Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66df9389-d007-4737-8bb1-55bcb5f227ff could not be found. Apr 18 16:30:18 user devstack@n-api.service[61294]: ERROR nova.api.openstack.wsgi Apr 18 16:30:18 user devstack@n-api.service[61294]: DEBUG nova.api.openstack.wsgi [None req-0f4ff0d2-d644-40ff-9682-07a5d5736f89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] Returning 404 to user: Instance 66df9389-d007-4737-8bb1-55bcb5f227ff could not be found. {{(pid=61294) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 16:30:18 user devstack@n-api.service[61294]: INFO nova.api.openstack.requestlog [None req-0f4ff0d2-d644-40ff-9682-07a5d5736f89 tempest-ServersNegativeTestJSON-1696086909 tempest-ServersNegativeTestJSON-1696086909-project-member] 10.0.0.210 "GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff" status: 404 len: 111 microversion: 2.1 time: 0.034669 Apr 18 16:30:18 user devstack@n-api.service[61294]: [pid: 61294|app: 0|req: 157/468] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 16:30:18 2023] GET /compute/v2.1/servers/66df9389-d007-4737-8bb1-55bcb5f227ff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)